-- Logs begin at Wed 2021-12-08 10:52:00 UTC, end at Wed 2021-12-08 11:57:39 UTC. -- Dec 08 11:23:05.296227 dv-cinder-819778-3-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Dec 08 11:23:08.098468 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.common.config [-] Logging enabled! Dec 08 11:23:08.098934 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev266 Dec 08 11:23:08.099258 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102176) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 08 11:23:08.102560 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.common.config [-] Logging enabled! Dec 08 11:23:08.102817 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev266 Dec 08 11:23:08.103133 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102176) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 08 11:23:08.104074 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 08 11:23:08.104310 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 08 11:23:08.104675 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 08 11:23:08.104921 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 08 11:23:08.105168 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 08 11:23:08.105490 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.105910 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Dec 08 11:23:08.106230 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.106525 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.106817 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.107110 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.107400 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.107682 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.107970 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.108268 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.108555 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.108832 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.109114 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.109433 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.109716 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] config_source = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.110002 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.110288 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.110571 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] debug = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.110853 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.111277 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.111692 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.112486 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.112918 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.113058 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.113362 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.113642 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.113927 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.114261 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] host = dv-cinder-819778-3-iscsi {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.114540 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.114826 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.115112 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.115396 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.115673 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.115951 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.116237 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.116513 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] log_dir = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.116785 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] log_file = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.117059 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.117372 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.117662 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.117953 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.118179 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.118401 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.118699 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.118986 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.119261 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.119534 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.119811 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.120086 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.120358 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.120626 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.120911 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.121224 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.121510 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.121786 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.122059 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.122331 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.122601 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.122883 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.123155 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.123424 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.123695 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.123981 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.124256 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.124528 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.124826 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.125111 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.125418 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.125701 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.125975 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.126255 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.126527 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.126798 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] use_journal = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.127069 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] use_json = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.127338 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.128284 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.128455 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.128730 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.129002 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.129300 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.129573 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.129856 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:08.130154 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.130449 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.130748 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.131031 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.131333 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.131612 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.131901 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.132236 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.132529 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.132817 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.133102 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.133408 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.133699 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.133978 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.134279 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.134583 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.134877 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.135167 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.135444 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.135717 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.136141 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.136484 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.136859 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.137144 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.137458 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.137942 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.138229 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.138600 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.138894 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.139192 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.139486 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.139763 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.140045 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.140338 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.140616 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.140891 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.141192 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.141487 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.141767 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.142040 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.142322 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.142601 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.142876 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.143195 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.143478 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.143772 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.144053 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.144328 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.144605 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.144884 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.145179 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.145462 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.145993 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.146268 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.146541 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.146820 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.147095 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.147369 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.147649 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.147922 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.148199 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.148473 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.148746 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.149019 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.149317 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.149593 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.149866 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.150140 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.150419 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.150692 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.150964 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.151238 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.151509 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.151782 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.152066 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.152364 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.152643 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.152920 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.153225 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.153507 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.153785 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.154063 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.154340 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.154623 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.154895 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.155186 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.155468 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.155753 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.156035 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.156340 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.156633 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.156908 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.157218 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.157498 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.157775 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.158056 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.158340 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.158653 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.158948 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.159242 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.159535 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.159825 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.160105 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.160410 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.160690 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:08.160909 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 08 11:23:08.161183 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=102176) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Dec 08 11:23:08.592613 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=102176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:23:08.592898 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=102176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:23:08.593235 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=102176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 08 11:23:08.593574 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.manager [-] Loading core plugin: ml2 Dec 08 11:23:08.922322 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:08.922547 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:08.922825 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:08.924130 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:08.924437 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:08.924705 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:08.970878 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:08.971182 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:08.971452 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:08.985535 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:08.985818 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:08.986095 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.014473 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.014756 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.015027 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.052503 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.052788 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.053061 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.390301 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.390915 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.390915 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.391153 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.391796 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.490990 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.491319 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.491601 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.491872 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.492139 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.492451 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.492712 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.492969 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.493258 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.493564 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.493807 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.494074 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.494335 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.494590 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.494846 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.495111 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.495368 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.495635 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.495905 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.496164 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.496440 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.496694 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.496976 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.497382 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.497635 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.497882 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.498282 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=102176) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 08 11:23:09.498535 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=102176) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 08 11:23:09.498776 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=102176) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 08 11:23:09.499020 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=102176) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 08 11:23:09.499260 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=102176) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 08 11:23:09.499498 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=102176) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 08 11:23:09.499860 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Dec 08 11:23:09.503530 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Dec 08 11:23:09.507644 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Dec 08 11:23:09.511503 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(250, 299)])]) Dec 08 11:23:09.513201 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Dec 08 11:23:09.513674 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Dec 08 11:23:09.514010 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Dec 08 11:23:09.514396 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Dec 08 11:23:09.517245 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Dec 08 11:23:09.517500 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Dec 08 11:23:09.517847 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Dec 08 11:23:09.523469 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Dec 08 11:23:09.546247 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Dec 08 11:23:09.546698 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.546998 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=102176) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Dec 08 11:23:09.547359 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.548747 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=102176) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Dec 08 11:23:09.549037 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Dec 08 11:23:09.549835 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Dec 08 11:23:09.553058 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.553366 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:09.616546 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Dec 08 11:23:09.616785 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Dec 08 11:23:09.617027 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Dec 08 11:23:09.617430 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Dec 08 11:23:09.639623 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_db.sqlalchemy.engines [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 08 11:23:10.077064 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Initializing driver for type 'gre' Dec 08 11:23:10.077653 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] gre ID ranges: [(1, 1000)] Dec 08 11:23:10.131700 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Initializing driver for type 'local' Dec 08 11:23:10.132046 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Initializing driver for type 'vlan' Dec 08 11:23:10.145859 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] VlanTypeDriver initialization complete Dec 08 11:23:10.146261 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Initializing driver for type 'vxlan' Dec 08 11:23:10.146751 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] vxlan ID ranges: [(1, 1000)] Dec 08 11:23:10.199382 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Initializing extension driver 'port_security' Dec 08 11:23:10.199674 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.extensions.port_security [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] PortSecurityExtensionDriver initialization complete Dec 08 11:23:10.200057 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Initializing mechanism driver 'openvswitch' Dec 08 11:23:10.200576 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Initializing mechanism driver 'hyperv' Dec 08 11:23:10.208513 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.plugins.ml2.plugin [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=102176) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:23:10.210731 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > port after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.211110 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > port after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.211464 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > port after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.212030 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=102176) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 08 11:23:10.212466 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > subnet after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.213373 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > subnet after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.213726 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.214138 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=102176) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 08 11:23:10.214556 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > network after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.216345 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > network after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.216715 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > network after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.217132 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=102176) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 08 11:23:10.217577 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > security_group after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.217931 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > security_group after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.218276 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > security_group after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.218823 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=102176) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 08 11:23:10.219233 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.219587 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.219933 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.220344 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=102176) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 08 11:23:10.220761 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > address_group after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.221677 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > address_group after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.222014 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > address_group after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.222419 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=102176) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 08 11:23:10.222805 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] ML2 OVO RPC backend initialized. {{(pid=102176) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Dec 08 11:23:10.223527 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.223882 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.224298 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > network before_response 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.224650 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > networks before_response 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.225003 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > port before_response 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.225380 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > ports before_response 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.225728 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > subnet before_response 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.226071 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > subnets before_response 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.226418 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > network after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.226758 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > network after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.227094 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > network after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.227544 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > port after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.227978 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > port after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.228326 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > port after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.228664 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > subnet after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.229020 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > subnet after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.229364 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.229948 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.plugin [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Modular L2 Plugin initialization complete Dec 08 11:23:10.230280 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading services supported by the core plugin {{(pid=102176) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Dec 08 11:23:10.230605 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.plugins.ml2.managers [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Got port-security extension from driver 'port_security' Dec 08 11:23:10.231066 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.extensions.vlantransparent [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Disabled vlantransparent extension. Dec 08 11:23:10.231551 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=102176) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Dec 08 11:23:10.231865 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading Plugin: router Dec 08 11:23:10.267491 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router_interface before_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.268374 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router after_create 55549900 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.268757 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router before_create 55549900 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.269124 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.269523 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.269883 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router after_delete 55549900 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.270245 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > floatingip after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.270864 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > floatingip after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.271225 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router after_create 55549900 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.271572 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router after_update 55549900 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.271927 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router after_update 55549900 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.272279 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.272642 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router after_update 55549900 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.273052 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router precommit_update 55549900 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.273516 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: port after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.273859 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: port after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.274198 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: subnet after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.274537 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.274886 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > port precommit_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.275234 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router precommit_create 55549900 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.275579 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: port before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.275928 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router precommit_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.276289 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router after_update 55549900 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.276636 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router precommit_delete 55549900 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.276994 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router precommit_create 55549900 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.277386 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.277735 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router precommit_update 55549900 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.278104 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > agent after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.278454 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > agent after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.278799 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > network after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.279656 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Tracking information for resource: router configured {{(pid=102176) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 08 11:23:10.279993 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Tracking information for resource: floatingip configured {{(pid=102176) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 08 11:23:10.285685 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.db.l3_agentschedulers_db [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Dec 08 11:23:10.286260 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: port after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.286620 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: port after_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.286977 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: port after_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.287329 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: port after_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.288113 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router before_create 55550100 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.288481 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router precommit_delete 55550100 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.288847 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router precommit_create 55550100 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.289237 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > router precommit_update 55550100 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.294100 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.services.provider_configuration [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service providers = [] {{(pid=102176) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Dec 08 11:23:10.294469 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.db.servicetype_db [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=102176) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Dec 08 11:23:10.297453 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.services.service_base [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=102176) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 08 11:23:10.297803 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.services.service_base [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=102176) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 08 11:23:10.298147 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.services.service_base [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=102176) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 08 11:23:10.299052 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.services.service_base [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=102176) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 08 11:23:10.299447 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.services.service_base [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Default provider is not specified for service type L3_ROUTER_NAT Dec 08 11:23:10.299819 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=102176) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 08 11:23:10.300137 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Dec 08 11:23:10.310860 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=102176) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 08 11:23:10.311195 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading Plugin: auto_allocate Dec 08 11:23:10.317032 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: network precommit_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.317443 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: network precommit_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.317960 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=102176) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 08 11:23:10.318283 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading Plugin: tag Dec 08 11:23:10.324846 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=102176) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 08 11:23:10.325203 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading Plugin: timestamp Dec 08 11:23:10.329277 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=102176) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 08 11:23:10.329569 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading Plugin: network_ip_availability Dec 08 11:23:10.335544 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.335919 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.336276 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.336985 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=102176) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 08 11:23:10.337339 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading Plugin: flavors Dec 08 11:23:10.342121 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=102176) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 08 11:23:10.342456 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading Plugin: revisions Dec 08 11:23:10.347427 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=102176) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 08 11:23:10.347814 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_concurrency.lockutils [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.755s {{(pid=102176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 08 11:23:10.348565 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=102176) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Dec 08 11:23:10.348902 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Initializing extension manager. Dec 08 11:23:10.349458 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: __init__.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.349810 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: __pycache__ {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.350147 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.350482 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: address_group.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.351233 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.351790 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: address-group Dec 08 11:23:10.352113 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: address_scope.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.353021 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.353570 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: address-scope Dec 08 11:23:10.353893 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: admin_state_down_before_update.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.354828 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.355339 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: router-admin-state-down-before-update Dec 08 11:23:10.355663 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: agent.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.356367 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.356874 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: agent Dec 08 11:23:10.357228 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: agent_resources_synced.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.358143 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.358650 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: agent-resources-synced Dec 08 11:23:10.358970 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: allowedaddresspairs.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.360753 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.361305 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: allowed-address-pairs Dec 08 11:23:10.361654 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: auto_allocated_topology.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.362746 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.363268 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: auto-allocated-topology Dec 08 11:23:10.363599 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: availability_zone.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.364300 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.364805 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: availability_zone Dec 08 11:23:10.365130 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: availability_zone_filter.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.366072 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.366583 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: availability_zone_filter Dec 08 11:23:10.366908 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: data_plane_status.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.367819 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.368327 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension data-plane-status not supported by any of loaded plugins Dec 08 11:23:10.368650 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: default_subnetpools.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.369617 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.370136 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: default-subnetpools Dec 08 11:23:10.370458 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: dhcpagentscheduler.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.371264 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.371772 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: dhcp_agent_scheduler Dec 08 11:23:10.372097 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: dns.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.373019 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.373560 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension dns-integration not supported by any of loaded plugins Dec 08 11:23:10.373883 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: dns_domain_ports.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.374806 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.375315 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension dns-domain-ports not supported by any of loaded plugins Dec 08 11:23:10.375639 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.376568 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.377072 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Dec 08 11:23:10.377441 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: dvr.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.378116 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.378622 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: dvr Dec 08 11:23:10.378941 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: ecmp_routes.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.379865 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.380366 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension ecmp_routes not supported by any of loaded plugins Dec 08 11:23:10.380687 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: empty_string_filtering.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.381631 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.382137 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: empty-string-filtering Dec 08 11:23:10.382467 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.383380 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.383883 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Dec 08 11:23:10.384205 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.385128 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.385655 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Dec 08 11:23:10.385979 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: external_net.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.386904 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.387418 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: external-net Dec 08 11:23:10.387739 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: extra_dhcp_opt.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.388650 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.389189 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: extra_dhcp_opt Dec 08 11:23:10.389518 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: extraroute.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.390439 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.390972 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: extraroute Dec 08 11:23:10.391259 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: extraroute_atomic.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.392286 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.392799 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: extraroute-atomic Dec 08 11:23:10.393657 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: filter_validation.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.394325 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.394831 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: filter-validation Dec 08 11:23:10.395153 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: fip_pf_description.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.396353 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.396857 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Dec 08 11:23:10.397208 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: fip_port_details.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.398126 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.398633 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: fip-port-details Dec 08 11:23:10.398957 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: flavors.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.400179 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.400695 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: flavors Dec 08 11:23:10.401021 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.402723 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.403241 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Dec 08 11:23:10.403575 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: floatingip_pools.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.404273 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.404787 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: floatingip-pools Dec 08 11:23:10.405116 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: ip_allocation.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.406099 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.406607 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension ip_allocation not supported by any of loaded plugins Dec 08 11:23:10.406932 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.407858 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.408368 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: ip-substring-filtering Dec 08 11:23:10.409266 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: l2_adjacency.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.410202 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.410704 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension l2_adjacency not supported by any of loaded plugins Dec 08 11:23:10.411026 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: l3.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.413359 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.413896 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: router Dec 08 11:23:10.414233 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: l3_conntrack_helper.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.416498 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.417027 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Dec 08 11:23:10.417390 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.418340 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.418857 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: ext-gw-mode Dec 08 11:23:10.419183 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.420109 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.420623 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: l3-ha Dec 08 11:23:10.420947 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: l3_flavors.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.421900 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.422413 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: l3-flavors Dec 08 11:23:10.422736 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.423654 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.424189 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: l3-port-ip-change-not-allowed Dec 08 11:23:10.424510 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: l3agentscheduler.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.425570 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.426084 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: l3_agent_scheduler Dec 08 11:23:10.426412 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: local_ip.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.428186 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.428715 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension local_ip not supported by any of loaded plugins Dec 08 11:23:10.429046 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: logging.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.430561 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.431082 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension logging not supported by any of loaded plugins Dec 08 11:23:10.431415 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: metering.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.432156 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.432731 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: metering Dec 08 11:23:10.433058 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.434181 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.434698 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: metering_source_and_destination_fields Dec 08 11:23:10.435024 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: multiprovidernet.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.435954 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.436463 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: multi-provider Dec 08 11:23:10.436787 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: netmtu.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.437736 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.438247 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: net-mtu Dec 08 11:23:10.438573 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: netmtu_writable.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.439501 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.440527 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: net-mtu-writable Dec 08 11:23:10.440849 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: network_availability_zone.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.441550 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.442060 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: network_availability_zone Dec 08 11:23:10.442381 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: network_ip_availability.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.443506 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.444029 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: network-ip-availability Dec 08 11:23:10.444355 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: network_segment_range.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.445121 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.445657 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension network-segment-range not supported by any of loaded plugins Dec 08 11:23:10.445981 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: pagination.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.446977 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.447308 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: pagination Dec 08 11:23:10.447628 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: port_device_profile.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.448678 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.449219 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: port-device-profile Dec 08 11:23:10.449548 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.450480 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.450989 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: port-mac-address-regenerate Dec 08 11:23:10.451312 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.452229 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.452738 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: port-numa-affinity-policy Dec 08 11:23:10.453059 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: port_resource_request.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.454011 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.454514 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension port-resource-request not supported by any of loaded plugins Dec 08 11:23:10.454837 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: port_resource_request_groups.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.456347 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.456855 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension port-resource-request-groups not supported by any of loaded plugins Dec 08 11:23:10.457206 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: portbindings.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.458146 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.458660 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: binding Dec 08 11:23:10.458985 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: portbindings_extended.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.460274 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.460798 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: binding-extended Dec 08 11:23:10.461128 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: portsecurity.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.462077 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.462592 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: port-security Dec 08 11:23:10.462919 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: project_id.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.463906 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.464238 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: project-id Dec 08 11:23:10.464565 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: providernet.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.465524 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.466035 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: provider Dec 08 11:23:10.466358 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: qos.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.469953 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.470482 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension qos not supported by any of loaded plugins Dec 08 11:23:10.470815 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.472096 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.472618 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Dec 08 11:23:10.472949 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.473906 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.474417 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Dec 08 11:23:10.474744 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: qos_default.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.475669 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.476184 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension qos-default not supported by any of loaded plugins Dec 08 11:23:10.476511 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: qos_fip.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.477189 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.477701 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension qos-fip not supported by any of loaded plugins Dec 08 11:23:10.478027 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: qos_fip_network_policy.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.479031 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension file qos_fip_network_policy.py wasn't loaded due to cannot import name 'qos_fip_network_policy' from 'neutron_lib.api.definitions' (/usr/local/lib/python3.8/dist-packages/neutron_lib/api/definitions/__init__.py) Dec 08 11:23:10.479365 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: qos_gateway_ip.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.480295 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.480808 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension qos-gateway-ip not supported by any of loaded plugins Dec 08 11:23:10.481136 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: qos_port_network_policy.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.482110 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.482621 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension qos-port-network-policy not supported by any of loaded plugins Dec 08 11:23:10.482948 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.483995 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.484503 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension qos-pps-minimum not supported by any of loaded plugins Dec 08 11:23:10.484830 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: qos_pps_rule.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.486045 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.486560 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension qos-pps not supported by any of loaded plugins Dec 08 11:23:10.486912 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: qos_rule_type_details.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.487842 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.488355 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension qos-rule-type-details not supported by any of loaded plugins Dec 08 11:23:10.488681 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: qos_rules_alias.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.489757 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.490284 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension qos-rules-alias not supported by any of loaded plugins Dec 08 11:23:10.490610 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: quota_check_limit.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.491522 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.492035 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: quota-check-limit Dec 08 11:23:10.492369 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: quotasv2.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.493342 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.493674 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: quotas Dec 08 11:23:10.493998 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: quotasv2_detail.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.497331 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.497677 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: quota_details Dec 08 11:23:10.498012 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: rbac.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.499080 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.499622 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: rbac-policies Dec 08 11:23:10.499954 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: rbac_address_group.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.500900 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.501455 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: rbac-address-group Dec 08 11:23:10.501780 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: rbac_address_scope.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.503249 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.503763 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: rbac-address-scope Dec 08 11:23:10.504089 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: rbac_security_groups.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.505009 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.505566 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: rbac-security-groups Dec 08 11:23:10.505885 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: rbac_subnetpool.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.506814 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.507339 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: rbac-subnetpool Dec 08 11:23:10.507660 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: revisionifmatch.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.509448 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.509968 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: revision-if-match Dec 08 11:23:10.510295 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: revisions.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.511434 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.511949 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: standard-attr-revisions Dec 08 11:23:10.512281 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: router_availability_zone.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.513000 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.513538 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: router_availability_zone Dec 08 11:23:10.513865 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: routerservicetype.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.514805 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.515318 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension router-service-type not supported by any of loaded plugins Dec 08 11:23:10.515644 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.516661 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.517198 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: security-groups-normalized-cidr Dec 08 11:23:10.517527 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: security_groups_port_filtering.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.518515 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.519542 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: port-security-groups-filtering Dec 08 11:23:10.519869 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.521062 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.521609 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: security-groups-remote-address-group Dec 08 11:23:10.521935 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.522867 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.523376 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: security-groups-shared-filtering Dec 08 11:23:10.523701 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.524281 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Dec 08 11:23:10.524601 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: securitygroup.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.534429 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.534965 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: security-group Dec 08 11:23:10.535298 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: segment.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.536090 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.536607 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension segment not supported by any of loaded plugins Dec 08 11:23:10.536935 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.537908 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.538427 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Dec 08 11:23:10.538755 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: servicetype.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.539882 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.540410 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: service-type Dec 08 11:23:10.540740 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: sorting.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.541776 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.542112 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: sorting Dec 08 11:23:10.542438 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: standard_attr_segment.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.543358 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.543877 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension standard-attr-segment not supported by any of loaded plugins Dec 08 11:23:10.544201 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: standardattrdescription.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.544857 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.545407 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: standard-attr-description Dec 08 11:23:10.545732 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: stateful_security_group.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.546667 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.547184 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: stateful-security-group Dec 08 11:23:10.547511 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: stdattrs_common.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.548085 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Dec 08 11:23:10.548409 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.549387 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.549903 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Dec 08 11:23:10.550226 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: subnet_onboard.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.551305 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.551831 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: subnet_onboard Dec 08 11:23:10.552159 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.553102 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.553635 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Dec 08 11:23:10.553959 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: subnet_service_types.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.555176 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.555695 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: subnet-service-types Dec 08 11:23:10.556023 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: subnetallocation.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.557135 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.557674 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: subnet_allocation Dec 08 11:23:10.558007 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.558681 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.559197 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: subnetpool-prefix-ops Dec 08 11:23:10.559528 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.560493 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.561006 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Dec 08 11:23:10.561365 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: tagging.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.562448 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.562965 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: standard-attr-tag Dec 08 11:23:10.563301 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: timestamp.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.564512 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.565587 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loaded extension: standard-attr-timestamp Dec 08 11:23:10.565915 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: trunk.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.566955 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.567475 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension trunk not supported by any of loaded plugins Dec 08 11:23:10.567803 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: trunk_details.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.568728 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.569272 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension trunk-details not supported by any of loaded plugins Dec 08 11:23:10.569601 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: uplink_status_propagation.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.570535 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.571046 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension uplink-status-propagation not supported by any of loaded plugins Dec 08 11:23:10.571373 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Loading extension file: vlantransparent.py {{(pid=102176) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 08 11:23:10.572057 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=102176) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 08 11:23:10.572563 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extension vlan-transparent not supported by any of loaded plugins Dec 08 11:23:10.575119 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:network Dec 08 11:23:10.575644 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:subnet Dec 08 11:23:10.576047 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:subnetpool Dec 08 11:23:10.576439 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:port Dec 08 11:23:10.577754 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.578204 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service FLAVORS assigned prefix: {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.578833 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.579331 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.579618 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:router Dec 08 11:23:10.580049 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:floatingip Dec 08 11:23:10.581196 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service METERING assigned prefix: /metering {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.582626 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.582998 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.583347 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102176) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:23:10.584360 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of CountableResource for resource:rbac_policy Dec 08 11:23:10.584806 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:security_group Dec 08 11:23:10.585275 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:security_group_rule Dec 08 11:23:10.585967 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service CORE assigned prefix: {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.586368 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:subnetpool Dec 08 11:23:10.586840 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] subnetpool is already registered Dec 08 11:23:10.587282 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service CORE assigned prefix: {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.587613 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:subnetpool Dec 08 11:23:10.587949 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] subnetpool is already registered Dec 08 11:23:10.590204 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.590640 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service FLAVORS assigned prefix: {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.591227 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.591651 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.591985 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:router Dec 08 11:23:10.592331 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] router is already registered Dec 08 11:23:10.592746 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:floatingip Dec 08 11:23:10.593083 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] floatingip is already registered Dec 08 11:23:10.593560 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service METERING assigned prefix: /metering {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.594219 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of CountableResource for resource:rbac_policy Dec 08 11:23:10.594545 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] rbac_policy is already registered Dec 08 11:23:10.594956 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:security_group Dec 08 11:23:10.595290 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] security_group is already registered Dec 08 11:23:10.595692 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:security_group_rule Dec 08 11:23:10.596048 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] security_group_rule is already registered Dec 08 11:23:10.596681 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service CORE assigned prefix: {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.597011 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:subnetpool Dec 08 11:23:10.597370 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] subnetpool is already registered Dec 08 11:23:10.597792 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.v2.resource_helper [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Service CORE assigned prefix: {{(pid=102176) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 08 11:23:10.598118 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Creating instance of TrackedResource for resource:subnetpool Dec 08 11:23:10.598449 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING neutron.quota.resource_registry [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] subnetpool is already registered Dec 08 11:23:10.598921 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: extensions {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.600390 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: address-groups {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.601904 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: address-scopes {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.603216 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: agents {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.604371 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: auto-allocated-topology {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.605678 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: availability_zones {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.606901 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: dhcp-networks {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.608402 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: dhcp-agents {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.609861 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: routers {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.612104 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: flavors {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.613343 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: service_profiles {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.614549 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: next_providers {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.615979 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: service_profiles {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.618460 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: floatingip-pools {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.619691 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: routers {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.621945 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: floatingips {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.623224 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: l3-routers {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.624602 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: l3-agents {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.626062 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: metering-labels {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.627935 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: metering-label-rules {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.629244 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: network-ip-availabilities {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.630511 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: bindings {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.632157 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: quotas {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.633767 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: quotas {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.635303 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: rbac-policies {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.636591 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: security-groups {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.637861 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: security-group-rules {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.639082 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: service-providers {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.640310 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: subnetpools {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.641767 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: subnetpools {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.643809 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: tags {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.645772 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: tags {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.647596 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: tags {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.649400 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: tags {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.651214 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: tags {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.653062 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: tags {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.654787 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: tags {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.656668 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: tags {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.658514 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: tags {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.660367 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron.api.extensions [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Extended resource: tags {{(pid=102176) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 08 11:23:10.666401 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING keystonemiddleware.auth_token [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 08 11:23:10.671108 dv-cinder-819778-3-iscsi neutron-server[102176]: WARNING keystonemiddleware.auth_token [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 08 11:23:10.679741 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_concurrency.lockutils [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Acquired lock "singleton_lock" {{(pid=102176) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 08 11:23:10.680207 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_concurrency.lockutils [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Releasing lock "singleton_lock" {{(pid=102176) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 08 11:23:10.680856 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO oslo_service.service [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Starting 2 workers Dec 08 11:23:10.685674 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Started child 102317 {{(pid=102176) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 08 11:23:10.690612 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Started child 102318 {{(pid=102176) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 08 11:23:10.691726 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:10.692426 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO neutron.service [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Neutron service started, listening on 0.0.0.0:9696 Dec 08 11:23:10.692850 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Publish callbacks [] for process, before_spawn {{(pid=102176) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:10.693200 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [-] (102317) wsgi starting up on http://0.0.0.0:9696 Dec 08 11:23:10.695342 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO oslo_service.service [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Starting 1 workers Dec 08 11:23:10.695841 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:10.697232 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [-] (102318) wsgi starting up on http://0.0.0.0:9696 Dec 08 11:23:10.700553 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Started child 102319 {{(pid=102176) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 08 11:23:10.701115 dv-cinder-819778-3-iscsi neutron-server[102176]: INFO oslo_service.service [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Starting 1 workers Dec 08 11:23:10.704492 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.service [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] calling RpcWorker wait() {{(pid=102319) _wait /opt/stack/neutron/neutron/service.py:128}} Dec 08 11:23:10.705002 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.service [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] returning from RpcWorker wait() {{(pid=102319) _wait /opt/stack/neutron/neutron/service.py:135}} Dec 08 11:23:10.706376 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Started child 102320 {{(pid=102176) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 08 11:23:10.707026 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:10.707170 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG neutron_lib.callbacks.manager [None req-0b46f6b7-1cc6-4f0a-8440-bfb5f3787d22 None None] Publish callbacks [] for process, after_spawn {{(pid=102176) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:10.707575 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:23:10.709250 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102176) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 08 11:23:10.709473 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 08 11:23:10.709662 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 08 11:23:10.709901 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 08 11:23:10.710224 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 08 11:23:10.710410 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 08 11:23:10.710931 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.711208 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.711465 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.711743 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.712060 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.712658 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.712904 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.713176 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.713458 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.713715 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.713866 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:10.714349 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.714349 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.714349 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.714582 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.714867 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.715066 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:23:10.715156 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.715348 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.715600 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.715777 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.716035 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.716294 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.716529 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.716818 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] debug = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.717061 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.717577 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.717809 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.718049 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.718266 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.718555 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.718799 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.719056 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.719290 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.719529 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.719784 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.720057 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.720291 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.720504 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.720742 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.720956 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.721288 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.721535 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.722008 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] host = dv-cinder-819778-3-iscsi {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.722225 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.722447 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.722711 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.722958 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.723217 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.723453 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.723713 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.723985 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.724214 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.724444 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.724700 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.724957 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.725194 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.725449 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_file = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.725622 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_options = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.725840 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.726109 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.726369 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.726566 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.726738 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.726919 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.727183 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.727348 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.727599 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.727815 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.728031 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.728245 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.728466 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.728708 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.728964 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.729719 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.729719 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.729719 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.729946 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.730125 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.730309 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.730542 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.730778 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.730999 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.731254 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.731447 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.731673 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.731887 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.732128 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.732363 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.732618 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.732860 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.733086 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.733347 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.733617 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.733862 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.734088 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.734299 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.734563 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.734793 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.735055 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.735300 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.735513 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.735758 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.735973 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.736206 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.736451 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] use_json = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.736714 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.736948 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.737226 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.737447 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.737675 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.737888 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.738122 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.738353 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.738794 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.739091 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.739442 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.739669 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.739901 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.740144 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.740378 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.740595 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.740854 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.741102 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.741467 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.741690 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.741970 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.742201 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.742456 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.742770 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.743047 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.743322 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.743567 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.743783 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.744031 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.745635 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.745635 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.745635 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.746811 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.746811 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.746811 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.746811 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.746811 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.747201 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.747396 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.747715 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.66/identity {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.747955 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.748277 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.748652 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.749330 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.751774 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.751774 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.751774 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.751774 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.753456 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.753456 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.753456 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.754986 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.755268 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.755904 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.756143 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.756413 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.756643 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.756882 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.757123 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.757386 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.758011 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.758269 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.758509 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.758769 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.759015 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.759812 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.760096 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.760317 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.760563 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.760814 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.761054 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.761321 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.761548 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.761765 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.762010 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.762217 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.762469 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.762689 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.762904 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.763119 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.763340 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.763576 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.763821 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.764061 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.764276 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.764494 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.764704 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.764940 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.765174 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.765397 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.765616 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.765854 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.766091 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.766332 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.766564 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.766786 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.767001 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.767214 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.767449 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.767763 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.768570 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.768823 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.769090 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.769342 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.769599 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.769826 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.770083 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.770303 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.770797 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.771029 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.771288 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.771551 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.771813 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.772093 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.773071 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.773071 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.773071 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.773071 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.773650 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.773650 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.773650 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.773996 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.774126 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.774324 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.774552 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.774914 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.775071 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.775729 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.775729 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.775996 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.776129 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.776333 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.776603 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.776854 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.777104 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.777361 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.777718 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.777915 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.778131 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.778415 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.778632 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.778870 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.779282 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.779444 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.779579 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.779822 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.780132 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.780365 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.780581 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.780844 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.781124 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.781369 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.781619 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.782294 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.782294 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.782511 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.782654 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.782900 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.66/identity {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.783115 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.783355 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.783644 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.783862 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.784235 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.784401 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.784614 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.784757 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.785012 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.785290 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.785487 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.785728 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.785958 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.786177 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.786396 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.786646 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.786858 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.787076 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.787515 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.787665 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.787813 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.787971 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.788178 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.788409 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.788625 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.788887 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.789165 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.789417 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.789663 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.789905 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.790154 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.790366 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.790611 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.790827 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.791038 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.791249 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.791468 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.791685 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.791916 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.792142 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.792637 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.792637 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.792920 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.793219 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.793430 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.793601 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.793828 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.794041 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.794256 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.794980 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.794980 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.794980 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.795384 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.795384 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.795877 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.795877 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.796155 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.796295 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.796439 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.796622 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.796872 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.797083 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.797426 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.797675 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.797906 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.798228 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.798393 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.798605 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.798859 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.799059 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.799803 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.800647 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.800647 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.800647 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.801094 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.801094 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.801413 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.801553 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.801787 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.802055 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.802283 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.802571 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.802727 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.802913 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.803131 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.803342 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.803567 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.803775 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.803999 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.804235 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.804436 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.804667 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.804891 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.805091 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.805324 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.805543 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.805757 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.805967 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.806797 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.806797 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.806797 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.807084 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.807247 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.807500 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.807757 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.808066 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.808300 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.808562 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.808788 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.809034 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.810232 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.810232 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.810232 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.810232 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.810586 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.810586 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.810806 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.811080 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:250:299'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.811350 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.811673 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.811979 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.812327 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.812618 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.812865 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.813095 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.813373 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.813616 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.813851 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.814089 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.814340 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.814572 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.814859 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.815583 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.815832 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.816046 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.816272 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.816524 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.816744 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.816974 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.817405 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.817627 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.817787 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 08 11:23:10.818306 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102176) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 08 11:23:10.818464 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 08 11:23:10.818775 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 08 11:23:10.818959 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 08 11:23:10.819138 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 08 11:23:10.819293 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 08 11:23:10.819500 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.819662 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.819824 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.820327 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.820327 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.820327 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.820604 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.820604 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.820760 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.820896 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.821236 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.821559 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.821872 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.822035 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.822191 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.822498 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.822660 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.822814 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.823124 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.823286 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.823446 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.823605 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.823763 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] debug = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.823922 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.824132 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.824319 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.824464 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.824621 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.824780 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.824938 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.825097 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.825278 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.825436 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.825580 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.825742 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.825901 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.826060 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.826217 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.826375 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.826532 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.826689 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.826845 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] host = dv-cinder-819778-3-iscsi {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.827002 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.827159 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.827317 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.827474 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.827632 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.827788 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.827946 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.828102 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.828258 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.828416 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.828574 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.828731 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.828890 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.829048 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_file = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.829216 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_options = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.829412 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.829553 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.829685 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.829836 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.830001 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.830161 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.830321 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.830504 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.830663 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.830821 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.830978 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.831135 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.831291 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.831448 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.831605 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.831767 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.831924 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.832083 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.832241 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.832399 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.832556 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.832718 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.832877 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.833295 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.833295 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.833467 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.833561 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.833641 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.833792 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.833952 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.834111 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.834265 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.834576 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.834736 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.834893 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.835050 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.835208 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.835366 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.835528 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.835752 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.835891 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.836043 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.836196 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.836387 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.836521 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.836678 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.836836 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] use_json = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.836998 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.837195 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.837348 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.837491 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.837643 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.837917 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.838033 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.838125 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 08 11:23:10.838270 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.838435 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.838606 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.838763 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.839080 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.839243 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.839406 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.839566 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.839727 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.839877 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.840041 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.840202 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.840373 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.840533 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.840693 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.840858 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.841018 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.841196 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.841362 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.841523 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.841688 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.841867 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.842014 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.842174 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.842335 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.842494 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.842653 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.842820 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.842979 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.843154 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.843341 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.843485 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.66/identity {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.843641 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.843791 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.843930 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.844080 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.844232 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.844372 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.844537 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.844700 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.844844 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.845008 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.845183 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.845330 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.845489 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.845642 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.845800 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.845944 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.846136 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.846291 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.846444 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.846591 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.846731 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.846919 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.847126 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.847268 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.848183 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.848183 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.848183 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.848183 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.848183 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.848183 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.848951 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.848951 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.848951 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.848951 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.848951 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.849572 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.849572 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.849572 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.849572 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.849810 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.849810 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.849926 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.850077 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.850238 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.850399 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.850560 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.850720 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.850882 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.851042 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.851203 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.851364 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.851526 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.851692 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.851853 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.852014 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.852177 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.852321 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.852480 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.852641 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.852809 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.853128 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.853128 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.853312 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.853478 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.853637 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.853799 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.853945 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.854105 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.854266 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.854427 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.854587 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.854747 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.854910 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.855069 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.855227 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.855386 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.855547 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.855705 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.855781 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:23:10.855853 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.856013 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.856172 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.856332 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.856493 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.856652 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.856814 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.856975 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.857177 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.857326 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.857491 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.857646 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.857798 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.857960 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.858120 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.858280 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.858439 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.858600 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.858759 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.858919 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.859077 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.859236 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.859394 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.859553 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.859722 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.859882 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.860042 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.860203 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.860387 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.860549 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.860708 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.860858 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.861015 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.861196 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.861351 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.861512 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.862185 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.862347 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.862507 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.862666 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.66/identity {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.862826 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.862987 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.863146 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.863306 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.863467 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.863645 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.863776 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.863936 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.864096 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.864256 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.864415 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.864574 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.864734 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.864894 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.865053 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.865234 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.865395 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.865559 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.865717 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.865873 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.866031 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.866189 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.866349 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.866509 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.866668 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.866830 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.866991 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.867151 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.867311 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.867472 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.867632 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.867795 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.867958 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.868117 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.868277 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.868437 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.868597 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.868751 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.868918 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.869663 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.869663 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.869663 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.869663 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.870983 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.870983 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.870983 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.870983 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.870983 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.870983 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.870983 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.870983 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.872203 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.872203 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.872203 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.872203 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.872684 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.872684 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.872943 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.873024 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.873389 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.873389 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.873565 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.873664 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.873800 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.873963 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.874125 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.874286 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.874447 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.874620 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.874781 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.874941 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.875101 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.875262 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.875422 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.875591 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.875750 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.875909 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.876068 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.876227 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.876385 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.876554 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.876714 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.876875 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.877033 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.877233 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.877962 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.877962 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.877962 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.877962 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.877962 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.877962 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.879276 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.879276 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.879421 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.879697 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.879990 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.880286 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.880581 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.880899 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.881227 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.881526 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.881825 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.882103 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.882279 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.882444 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.882623 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.882786 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.882953 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.883114 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.883274 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.883434 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.883601 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.883769 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.883924 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.884095 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.884241 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.884416 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.884585 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:250:299'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.884752 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.884898 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.885070 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.885266 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.885412 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.885575 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.885716 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.885875 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.886038 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.886182 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.886347 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.886491 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.886657 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.886801 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.886968 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.887114 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.887277 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.887421 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.887585 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.887746 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.887906 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.888122 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.888259 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 08 11:23:10.888401 dv-cinder-819778-3-iscsi neutron-server[102176]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 08 11:23:10.969127 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 47362) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:23:10.977811 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [-] 10.222.0.66 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0064352 Dec 08 11:23:22.458905 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd9df3d5-3469-4ccd-9409-8f9a5fb72922 None None] get_active_networks_info from dv-cinder-819778-3-iscsi {{(pid=102319) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 08 11:23:22.562437 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd9df3d5-3469-4ccd-9409-8f9a5fb72922 None None] No non-hosted networks {{(pid=102319) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Dec 08 11:23:22.599546 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.agentschedulers_db [None req-cd9df3d5-3469-4ccd-9409-8f9a5fb72922 None None] DHCP Agent not found on host dv-cinder-819778-3-iscsi {{(pid=102319) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Dec 08 11:23:22.661650 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0b01d592-5258-486f-bf58-1ed370596554 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-7896852'] for agent, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:24.649677 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-8e0aa036-e3b7-4228-8bcb-18f87ebbffb6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-7896852'] for agent, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:24.697574 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-86da1473-15e8-4931-8868-a920036fbd6e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:25.763710 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-7896852'] for agent, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:27.138766 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-7896852'] for agent, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:28.074924 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-7896852'] for agent, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:28.076001 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:28.076331 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:28.079361 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:28.080551 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:28.080941 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:28.081482 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:28.082040 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:28.082396 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:28.082726 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:28.083182 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:28.084139 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:28.084465 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:28.084784 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:28.085478 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-819778-3-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:23:28.093711 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-819778-3-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:23:28.641387 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 47450) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:23:29.162207 dv-cinder-819778-3-iscsi neutron-server[102317]: WARNING oslo_policy.policy [None req-f5406140-ffb5-4811-911e-6d078164706d admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 08 11:23:29.162926 dv-cinder-819778-3-iscsi neutron-server[102317]: WARNING oslo_policy.policy [None req-f5406140-ffb5-4811-911e-6d078164706d admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 08 11:23:29.392297 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [None req-f5406140-ffb5-4811-911e-6d078164706d admin admin] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102317) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:23:29.393604 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-f5406140-ffb5-4811-911e-6d078164706d admin admin] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7512834 Dec 08 11:23:31.152558 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.db.l3_hamode_db [None req-9d128368-e4f9-423e-85c0-23714eca7269 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Dec 08 11:23:31.229709 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d128368-e4f9-423e-85c0-23714eca7269 None None] Routers set() bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:23:31.230103 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d128368-e4f9-423e-85c0-23714eca7269 None None] Router IDs set() for agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 08 11:23:31.965632 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 47466) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:23:32.271868 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-0e4cf87a-5de7-4410-9162-6e9bbafb7963 admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26, 'is_default': True, 'name': 'shared-default-subnetpool-v4', 'shared': True}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:23:32.367413 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.policy [None req-0e4cf87a-5de7-4410-9162-6e9bbafb7963 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102317) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 08 11:23:32.414812 dv-cinder-819778-3-iscsi neutron-server[102317]: WARNING oslo_policy.policy [None req-0e4cf87a-5de7-4410-9162-6e9bbafb7963 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 08 11:23:32.415177 dv-cinder-819778-3-iscsi neutron-server[102317]: WARNING oslo_policy.policy [None req-0e4cf87a-5de7-4410-9162-6e9bbafb7963 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 08 11:23:32.424403 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.quota [None req-0e4cf87a-5de7-4410-9162-6e9bbafb7963 admin admin] Loaded quota_driver: . Dec 08 11:23:32.511927 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e4cf87a-5de7-4410-9162-6e9bbafb7963 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8729990207774', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8729990209393', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8729990222238', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8729990221414', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8729990238927', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8729990235242', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-540935', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-832764', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-8361258', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-8275309'] for rbac-policy, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:32.578908 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e4cf87a-5de7-4410-9162-6e9bbafb7963 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:32.580597 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-0e4cf87a-5de7-4410-9162-6e9bbafb7963 admin admin] 10.222.0.66 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6139643 Dec 08 11:23:35.357332 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 47478) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:23:35.650128 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Request body: {'network': {'name': 'private', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'admin_state_up': True, 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:23:35.678491 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Made reservation on behalf of 3fc95dfb2d714098b7ddd3e4e4eda6e6 for: {'network': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:23:35.681087 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:35.698236 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:35.806449 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:35.810291 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:35.829824 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] vlan segment allocate from pool success with {'vlan_id': 282, 'physical_network': 'physnet1'} {{(pid=102317) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:23:35.856427 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8729987010407', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:35.857006 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Unsubscribe: segment precommit_create {{(pid=102317) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 08 11:23:35.857545 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.segments_db [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Added segment 436f621c-e532-4526-ad49-fcbdc9585a32 of type vlan for network 84a89399-8902-4580-9fe7-2581eae0be73 Dec 08 11:23:35.877926 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=054b2a3c-a1a9-415d-9a03-31fdeffa4d76,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:23:35.924773 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:35.925128 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:35.925503 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:35.925835 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:35.926161 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:35.926487 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:35.926806 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:35.927126 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:35.927446 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:35.927778 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:35.928096 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:35.928411 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:35.928721 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Tracked resource versions report: Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: pushed versions: Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: { 'AddressGroup': {'1.2'}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'ConntrackHelper': {'1.0'}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'LocalIPAssociation': {'1.0'}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Log': {'1.0'}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Network': {'1.1'}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Port': {'1.7'}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'PortForwarding': {'1.2'}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'QosPolicy': {'1.10'}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'SecurityGroup': {'1.5'}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'SecurityGroupRule': {'1.2'}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'SubPort': {'1.0'}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Subnet': {'1.1'}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Trunk': {'1.1'}} Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: consumer versions: Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: { DHCP agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: L3 agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: Metadata agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: Metering agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: Open vSwitch agent@dv-cinder-819778-3-iscsi: { 'AddressGroup': '1.2', Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'ConntrackHelper': '1.0', Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'LocalIPAssociation': '1.0', Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Log': '1.0', Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Network': '1.1', Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Port': '1.7', Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'PortForwarding': '1.2', Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'QosPolicy': '1.10', Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'SecurityGroup': '1.5', Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'SecurityGroupRule': '1.2', Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'SubPort': '1.0', Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Subnet': '1.1', Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Trunk': '1.1'}} Dec 08 11:23:35.930057 dv-cinder-819778-3-iscsi neutron-server[102317]: {{(pid=102317) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 08 11:23:35.980306 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:36.018689 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:36.019733 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:23:36.020687 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:36.103046 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7446301 Dec 08 11:23:36.133970 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-886b7d06-f96c-46b7-9656-bb7df5152247 admin admin] Pushing event updated for resources: {'Network': ['ID=84a89399-8902-4580-9fe7-2581eae0be73,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:23:36.146253 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network 84a89399-8902-4580-9fe7-2581eae0be73 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:23:38.959854 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 47492) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:23:39.352939 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-458688d0-e334-4662-9abd-0c36d437c39c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:23:39.354748 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-458688d0-e334-4662-9abd-0c36d437c39c admin admin] 10.222.0.66 "GET /v2.0/networks/84a89399-8902-4580-9fe7-2581eae0be73 HTTP/1.1" status: 200 len: 825 time: 0.3939066 Dec 08 11:23:39.381470 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-3bb85f84-bfb4-4f53-9544-8ca533be9f53 admin admin] 10.222.0.66 "GET /v2.0/subnetpools/fa0fa68f-abb6-42a8-a7a1-1cf35392e68b HTTP/1.1" status: 200 len: 734 time: 0.0195670 Dec 08 11:23:39.390462 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-e1f15440-a0df-4aec-b6a8-c2cc39d6dd3e admin admin] Request body: {'subnet': {'ip_version': 4, 'name': 'private-subnet', 'gateway_ip': '172.20.0.1', 'subnetpool_id': 'fa0fa68f-abb6-42a8-a7a1-1cf35392e68b', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:23:39.412438 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e1f15440-a0df-4aec-b6a8-c2cc39d6dd3e admin admin] Made reservation on behalf of 3fc95dfb2d714098b7ddd3e4e4eda6e6 for: {'subnet': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:23:39.414797 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e1f15440-a0df-4aec-b6a8-c2cc39d6dd3e admin admin] Publish callbacks [] for subnet, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:39.706487 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e1f15440-a0df-4aec-b6a8-c2cc39d6dd3e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for subnet, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:39.795307 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1f15440-a0df-4aec-b6a8-c2cc39d6dd3e admin admin] Pushing event updated for resources: {'Subnet': ['ID=2446cdbc-ba1d-4ad5-b4ea-8577435adf22,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:23:39.799866 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1f15440-a0df-4aec-b6a8-c2cc39d6dd3e admin admin] Checking segment: {'id': '436f621c-e532-4526-ad49-fcbdc9585a32', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:23:39.800464 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1f15440-a0df-4aec-b6a8-c2cc39d6dd3e admin admin] Network hostable DHCP agents. Network: 84a89399-8902-4580-9fe7-2581eae0be73, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102317) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:23:39.820231 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1f15440-a0df-4aec-b6a8-c2cc39d6dd3e admin admin] Network 84a89399-8902-4580-9fe7-2581eae0be73 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102317) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:23:39.831142 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-e1f15440-a0df-4aec-b6a8-c2cc39d6dd3e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, 84a89399-8902-4580-9fe7-2581eae0be73) {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:23:39.835923 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1f15440-a0df-4aec-b6a8-c2cc39d6dd3e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:23:39.836521 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e1f15440-a0df-4aec-b6a8-c2cc39d6dd3e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:39.841776 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1980d7e5-5050-4b51-a43b-7474485e3719 None None] Network 84a89399-8902-4580-9fe7-2581eae0be73 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:23:39.852550 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-e1f15440-a0df-4aec-b6a8-c2cc39d6dd3e admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4653602 Dec 08 11:23:40.105850 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp49d6adb3-88e2-5e36-b97e-28b28be9cdf8-84a89399-8902-4580-9fe7-2581eae0be73', 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73', 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'fixed_ips': [{'subnet_id': '2446cdbc-ba1d-4ad5-b4ea-8577435adf22'}]}} from dv-cinder-819778-3-iscsi. {{(pid=102319) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 08 11:23:40.107143 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:40.407950 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.db_base_plugin_common [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Allocated IP 172.20.0.2 (84a89399-8902-4580-9fe7-2581eae0be73/2446cdbc-ba1d-4ad5-b4ea-8577435adf22/0613ba11-310a-4ccc-8f4f-fd21bb1f8a73) {{(pid=102319) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:23:40.646314 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Publish callbacks [] for port, precommit_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:40.655183 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:40.721939 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Network 84a89399-8902-4580-9fe7-2581eae0be73 is already hosted by enough agents. {{(pid=102319) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:23:40.730691 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.base_scheduler [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Resources bound (agent type, host, resource id): {{(pid=102319) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:23:40.742866 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Received port after_create {{(pid=102319) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:23:40.750572 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Pushing event updated for resources: {'Port': ['ID=0613ba11-310a-4ccc-8f4f-fd21bb1f8a73,revision_number=1']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:23:40.792708 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:40.793058 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:40.793447 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:40.793797 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:40.794130 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:40.794458 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:40.794785 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:40.795111 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:40.795440 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:40.795782 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:40.796117 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:40.796438 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:40.796758 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Tracked resource versions report: Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: pushed versions: Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: { 'AddressGroup': {'1.2'}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'ConntrackHelper': {'1.0'}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'LocalIPAssociation': {'1.0'}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Log': {'1.0'}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Network': {'1.1'}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Port': {'1.7'}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'PortForwarding': {'1.2'}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'QosPolicy': {'1.10'}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'SecurityGroup': {'1.5'}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'SecurityGroupRule': {'1.2'}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'SubPort': {'1.0'}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Subnet': {'1.1'}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Trunk': {'1.1'}} Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: consumer versions: Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: { DHCP agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: L3 agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: Metadata agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: Metering agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: Open vSwitch agent@dv-cinder-819778-3-iscsi: { 'AddressGroup': '1.2', Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'ConntrackHelper': '1.0', Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'LocalIPAssociation': '1.0', Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Log': '1.0', Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Network': '1.1', Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Port': '1.7', Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'PortForwarding': '1.2', Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'QosPolicy': '1.10', Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'SecurityGroup': '1.5', Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'SecurityGroupRule': '1.2', Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'SubPort': '1.0', Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Subnet': '1.1', Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Trunk': '1.1'}} Dec 08 11:23:40.798693 dv-cinder-819778-3-iscsi neutron-server[102319]: {{(pid=102319) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 08 11:23:40.831366 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Attempting to bind port 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73 on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:23:40.831771 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Attempting to bind port 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73 by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '436f621c-e532-4526-ad49-fcbdc9585a32', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:23:40.832197 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Attempting to bind port 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73 on network 84a89399-8902-4580-9fe7-2581eae0be73 {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:23:40.837007 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 23, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:23:40.837424 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Checking segment: {'id': '436f621c-e532-4526-ad49-fcbdc9585a32', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:23:40.837908 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:40.838299 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Bound using segment: {'id': '436f621c-e532-4526-ad49-fcbdc9585a32', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:23:40.838788 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Bound port: 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '436f621c-e532-4526-ad49-fcbdc9585a32', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:23:40.839200 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:40.901503 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] For port 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:23:40.905669 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] For port 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=0613ba11-310a-4ccc-8f4f-fd21bb1f8a73,segment=NetworkSegment(436f621c-e532-4526-ad49-fcbdc9585a32),segment_id=436f621c-e532-4526-ad49-fcbdc9585a32)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:23:40.910900 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:40.972463 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa09eba0-ed23-4d4b-8419-35b0d03c1c5f None None] Pushing event updated for resources: {'Port': ['ID=0613ba11-310a-4ccc-8f4f-fd21bb1f8a73,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:23:42.482266 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 47500) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:23:42.792460 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [None req-bedc56d5-9916-47e1-a3d6-c41339e4c672 admin admin] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102317) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:23:42.805223 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-bedc56d5-9916-47e1-a3d6-c41339e4c672 admin admin] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3103206 Dec 08 11:23:45.415319 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 47508) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:23:45.731028 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [None req-8c79d3f8-e54b-43cc-af87-673d144a8112 admin admin] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102317) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:23:45.732040 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-8c79d3f8-e54b-43cc-af87-673d144a8112 admin admin] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3157794 Dec 08 11:23:48.550756 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 47518) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:23:48.858176 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-1829d9f9-1cdc-40c3-95c8-99f99bc4fb5d admin admin] Request body: {'router': {'admin_state_up': True, 'name': 'router1', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:23:48.882396 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1829d9f9-1cdc-40c3-95c8-99f99bc4fb5d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7895423', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32171'] for router, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:48.883860 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1829d9f9-1cdc-40c3-95c8-99f99bc4fb5d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7895279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7889720', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7925360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32176'] for router, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:49.015568 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1829d9f9-1cdc-40c3-95c8-99f99bc4fb5d admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:49.021551 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1829d9f9-1cdc-40c3-95c8-99f99bc4fb5d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7895264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7889773'] for router, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:49.036676 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1829d9f9-1cdc-40c3-95c8-99f99bc4fb5d admin admin] Publish callbacks [] for router, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:49.037937 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-1829d9f9-1cdc-40c3-95c8-99f99bc4fb5d admin admin] 10.222.0.66 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.4861774 Dec 08 11:23:49.892923 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:23:49.978527 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:23:49.979034 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:50.014454 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d846658-47b5-4713-972f-5acd195267d0 None None] Network 84a89399-8902-4580-9fe7-2581eae0be73 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:23:50.163966 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:50.197961 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-b37f37bf-498e-4b19-88de-6ef7660d9559 None None] Provisioning complete for port 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:23:50.198319 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b37f37bf-498e-4b19-88de-6ef7660d9559 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:50.262587 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=0613ba11-310a-4ccc-8f4f-fd21bb1f8a73,segment=NetworkSegment(436f621c-e532-4526-ad49-fcbdc9585a32),segment_id=436f621c-e532-4526-ad49-fcbdc9585a32)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:23:50.272747 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:50.329415 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=0613ba11-310a-4ccc-8f4f-fd21bb1f8a73,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:23:50.489500 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-816adca1-d868-415f-a9a7-ebbe0f96f146 None None] Provisioning complete for port 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:23:50.489876 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-816adca1-d868-415f-a9a7-ebbe0f96f146 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:51.593821 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 47532) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:23:51.863587 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:23:51.903738 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [None req-d6654e0d-17aa-4433-81c8-ba67aa2ee4ef admin admin] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102317) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:23:51.904745 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-d6654e0d-17aa-4433-81c8-ba67aa2ee4ef admin admin] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3099654 Dec 08 11:23:51.910264 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:23:51.910636 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:52.426344 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-cbf87e33-60a2-4ad5-b396-5f28acd3fa20 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:54.458111 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 47540) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:23:54.651676 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-53ca4946-3b23-4c39-bae0-baf2d76451ea None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:54.950280 dv-cinder-819778-3-iscsi neutron-server[102318]: WARNING oslo_policy.policy [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 08 11:23:54.950873 dv-cinder-819778-3-iscsi neutron-server[102318]: WARNING oslo_policy.policy [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 08 11:23:55.180793 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Request body: {'network': {'admin_state_up': True, 'provider:physical_network': 'physnet1', 'router:external': True, 'is_default': True, 'name': 'public', 'provider:network_type': 'flat'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:23:55.182523 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.quota [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Loaded quota_driver: . Dec 08 11:23:55.237982 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Made reservation on behalf of b2cbded7915940edb7942bc90cb927db for: {'network': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:23:55.305799 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.policy [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102318) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 08 11:23:55.352235 dv-cinder-819778-3-iscsi neutron-server[102318]: WARNING oslo_policy.policy [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 08 11:23:55.352554 dv-cinder-819778-3-iscsi neutron-server[102318]: WARNING oslo_policy.policy [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 08 11:23:55.363046 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:55.382299 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:55.491691 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:55.495632 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:55.507247 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Reserving flat network on physical network physnet1 {{(pid=102318) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Dec 08 11:23:55.544984 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8729987010407', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:55.545596 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Unsubscribe: segment precommit_create {{(pid=102318) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 08 11:23:55.546119 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.segments_db [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Added segment aced9233-ae52-4905-86c8-d88de08554cc of type flat for network d7cb3021-649a-44ca-b3a1-005b3941164e Dec 08 11:23:55.566755 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=500e57f6-874d-4374-aa6a-3f10ae9fd813,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:23:55.601368 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:55.601717 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:55.602063 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:55.602451 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:55.602734 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:55.603063 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:55.603389 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:55.603715 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:55.604038 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:55.604377 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:55.604702 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:55.605025 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:55.605367 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Tracked resource versions report: Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: pushed versions: Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: { 'AddressGroup': {'1.2'}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'ConntrackHelper': {'1.0'}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'LocalIPAssociation': {'1.0'}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Log': {'1.0'}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Network': {'1.1'}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Port': {'1.7'}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'PortForwarding': {'1.2'}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'QosPolicy': {'1.10'}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'SecurityGroup': {'1.5'}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'SecurityGroupRule': {'1.2'}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'SubPort': {'1.0'}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Subnet': {'1.1'}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Trunk': {'1.1'}} Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: consumer versions: Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: { DHCP agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: L3 agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: Metadata agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: Metering agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: Open vSwitch agent@dv-cinder-819778-3-iscsi: { 'AddressGroup': '1.2', Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'ConntrackHelper': '1.0', Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'LocalIPAssociation': '1.0', Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Log': '1.0', Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Network': '1.1', Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Port': '1.7', Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'PortForwarding': '1.2', Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'QosPolicy': '1.10', Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'SecurityGroup': '1.5', Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'SecurityGroupRule': '1.2', Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'SubPort': '1.0', Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Subnet': '1.1', Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Trunk': '1.1'}} Dec 08 11:23:55.606688 dv-cinder-819778-3-iscsi neutron-server[102318]: {{(pid=102318) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 08 11:23:55.683952 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:55.700605 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:55.731565 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:55.732942 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:23:55.733750 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:55.835443 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 1.3751402 Dec 08 11:23:55.838417 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39945584-2bdc-4195-b020-362a8b7a140a admin admin] Pushing event updated for resources: {'Network': ['ID=d7cb3021-649a-44ca-b3a1-005b3941164e,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:23:55.853211 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network d7cb3021-649a-44ca-b3a1-005b3941164e details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:23:57.063638 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:58.072751 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:58.414681 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 47570) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:23:58.629546 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c990c68a-7349-47cd-a251-da0d077a1b57 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:23:58.630920 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-c990c68a-7349-47cd-a251-da0d077a1b57 admin admin] 10.222.0.66 "GET /v2.0/subnets/2446cdbc-ba1d-4ad5-b4ea-8577435adf22 HTTP/1.1" status: 200 len: 849 time: 0.2152653 Dec 08 11:23:58.786376 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-e2aee9c2-0ccf-4082-b662-593c1bce4d14 admin admin] 10.222.0.66 "GET /v2.0/routers/49734544-e5a8-4e6b-97e0-f65965989882 HTTP/1.1" status: 200 len: 704 time: 0.1494267 Dec 08 11:23:59.074324 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:59.368860 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Allocated IP 172.20.0.1 (84a89399-8902-4580-9fe7-2581eae0be73/2446cdbc-ba1d-4ad5-b4ea-8577435adf22/87f71867-939e-4448-878f-26bc78d852dc) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:23:59.552362 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:59.618214 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:59.685993 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Network 84a89399-8902-4580-9fe7-2581eae0be73 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:23:59.692140 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:23:59.704022 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:23:59.704208 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7898680'] for router_interface, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:59.759068 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Pushing event updated for resources: {'Port': ['ID=87f71867-939e-4448-878f-26bc78d852dc,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:23:59.897101 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:59.936809 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-70994110-2edb-4a92-9694-7a2ec2435b44 None None] Provisioning complete for port 87f71867-939e-4448-878f-26bc78d852dc triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:23:59.937374 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-70994110-2edb-4a92-9694-7a2ec2435b44 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:23:59.970863 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-70994110-2edb-4a92-9694-7a2ec2435b44 None None] Port 87f71867-939e-4448-878f-26bc78d852dc cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:24:00.151198 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:00.155996 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:00.157282 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8074899', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7897000'] for router_interface, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:00.231993 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Pushing event updated for resources: {'Port': ['ID=87f71867-939e-4448-878f-26bc78d852dc,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:24:00.278413 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Network 84a89399-8902-4580-9fe7-2581eae0be73 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:24:00.279685 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:24:00.438331 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Router 49734544-e5a8-4e6b-97e0-f65965989882 is scheduled to L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f with binding_index 1 {{(pid=102318) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 08 11:24:00.494027 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-0fb3b7af-f72f-41cb-b029-78d0255b3276 None None] Provisioning complete for port 87f71867-939e-4448-878f-26bc78d852dc triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:24:00.494325 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0fb3b7af-f72f-41cb-b029-78d0255b3276 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:00.528952 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-0fb3b7af-f72f-41cb-b029-78d0255b3276 None None] Port 87f71867-939e-4448-878f-26bc78d852dc cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:24:00.532246 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:24:00.537341 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-da73a78c-9731-4d32-b164-2cc11ad53f15 admin admin] 10.222.0.66 "PUT /v2.0/routers/49734544-e5a8-4e6b-97e0-f65965989882/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.7454445 Dec 08 11:24:00.542114 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Sync routers for ids ['49734544-e5a8-4e6b-97e0-f65965989882'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:24:00.554811 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Routers {'49734544-e5a8-4e6b-97e0-f65965989882'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:24:00.555619 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:23:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['49734544-e5a8-4e6b-97e0-f65965989882'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:24:00.744242 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Set router 49734544-e5a8-4e6b-97e0-f65965989882 gateway port host: None {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:24:01.165922 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49734544-e5a8-4e6b-97e0-f65965989882', 'name': 'router1', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:23:48Z', 'updated_at': '2021-12-08T11:23:59Z', 'revision_number': 2, 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'gw_port_host': None, '_interfaces': [{'id': '87f71867-939e-4448-878f-26bc78d852dc', 'name': '', 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'mac_address': 'fa:16:3e:a8:9f:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '49734544-e5a8-4e6b-97e0-f65965989882', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2446cdbc-ba1d-4ad5-b4ea-8577435adf22', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:23:59Z', 'updated_at': '2021-12-08T11:23:59Z', 'revision_number': 2, 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'subnets': [{'id': '2446cdbc-ba1d-4ad5-b4ea-8577435adf22', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'fa0fa68f-abb6-42a8-a7a1-1cf35392e68b'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:24:01.215814 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Checking router: 49734544-e5a8-4e6b-97e0-f65965989882 for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:24:01.216179 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Updating router 49734544-e5a8-4e6b-97e0-f65965989882 port 87f71867-939e-4448-878f-26bc78d852dc binding host dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:24:01.263454 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:01.763580 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Publish callbacks [] for port, precommit_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:01.770952 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:01.937500 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Pushing event updated for resources: {'Port': ['ID=87f71867-939e-4448-878f-26bc78d852dc,revision_number=3']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:24:01.942063 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Attempting to bind port 87f71867-939e-4448-878f-26bc78d852dc on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:24:01.942470 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Attempting to bind port 87f71867-939e-4448-878f-26bc78d852dc by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '436f621c-e532-4526-ad49-fcbdc9585a32', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73'}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:24:01.942899 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Attempting to bind port 87f71867-939e-4448-878f-26bc78d852dc on network 84a89399-8902-4580-9fe7-2581eae0be73 {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:24:01.951054 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:24:01.951407 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:24:01.951748 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:24:01.952090 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:24:01.952422 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:24:01.952748 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:24:01.953718 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:24:01.953962 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:24:01.954294 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:24:01.954620 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:24:01.954945 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:24:01.955357 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:24:01.955681 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Tracked resource versions report: Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: pushed versions: Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: { 'AddressGroup': {'1.2'}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'ConntrackHelper': {'1.0'}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'LocalIPAssociation': {'1.0'}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Log': {'1.0'}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Network': {'1.1'}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Port': {'1.7'}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'PortForwarding': {'1.2'}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'QosPolicy': {'1.10'}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'SecurityGroup': {'1.5'}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'SecurityGroupRule': {'1.2'}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'SubPort': {'1.0'}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Subnet': {'1.1'}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Trunk': {'1.1'}} Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: consumer versions: Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: { DHCP agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: L3 agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: Metadata agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: Metering agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: Open vSwitch agent@dv-cinder-819778-3-iscsi: { 'AddressGroup': '1.2', Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'ConntrackHelper': '1.0', Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'LocalIPAssociation': '1.0', Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Log': '1.0', Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Network': '1.1', Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Port': '1.7', Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'PortForwarding': '1.2', Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'QosPolicy': '1.10', Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'SecurityGroup': '1.5', Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'SecurityGroupRule': '1.2', Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'SubPort': '1.0', Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Subnet': '1.1', Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Trunk': '1.1'}} Dec 08 11:24:01.957804 dv-cinder-819778-3-iscsi neutron-server[102320]: {{(pid=102320) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 08 11:24:01.959645 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-9a3dc1d8-0614-4316-adba-51f8054dda42 None None] Provisioning complete for port 87f71867-939e-4448-878f-26bc78d852dc triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:24:01.959645 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9a3dc1d8-0614-4316-adba-51f8054dda42 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:01.962749 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 23, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:24:01.962749 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Checking segment: {'id': '436f621c-e532-4526-ad49-fcbdc9585a32', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102320) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:24:01.962749 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:01.963052 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Bound using segment: {'id': '436f621c-e532-4526-ad49-fcbdc9585a32', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73'} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:24:01.963536 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Bound port: 87f71867-939e-4448-878f-26bc78d852dc, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '436f621c-e532-4526-ad49-fcbdc9585a32', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 282, 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73'}}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:24:01.963930 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:01.994674 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-9a3dc1d8-0614-4316-adba-51f8054dda42 None None] Port 87f71867-939e-4448-878f-26bc78d852dc cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:24:02.032528 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] For port 87f71867-939e-4448-878f-26bc78d852dc, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102320) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:24:02.050928 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] For port 87f71867-939e-4448-878f-26bc78d852dc, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=87f71867-939e-4448-878f-26bc78d852dc,segment=NetworkSegment(436f621c-e532-4526-ad49-fcbdc9585a32),segment_id=436f621c-e532-4526-ad49-fcbdc9585a32)] {{(pid=102320) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:24:02.056189 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:02.115983 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7ef61e0-0f77-49c2-ab88-583b25050da0 None None] Pushing event updated for resources: {'Port': ['ID=87f71867-939e-4448-878f-26bc78d852dc,revision_number=4']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:24:02.120220 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Routers {'49734544-e5a8-4e6b-97e0-f65965989882'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:24:02.120804 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:23:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['49734544-e5a8-4e6b-97e0-f65965989882'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:24:02.207583 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] Set router 49734544-e5a8-4e6b-97e0-f65965989882 gateway port host: None {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:24:02.317868 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-51a84f24-108b-4c97-ae69-78f4b1fbf41e None None] Provisioning complete for port 87f71867-939e-4448-878f-26bc78d852dc triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:24:02.318304 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-51a84f24-108b-4c97-ae69-78f4b1fbf41e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:02.397851 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-51a84f24-108b-4c97-ae69-78f4b1fbf41e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:02.420835 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49734544-e5a8-4e6b-97e0-f65965989882', 'name': 'router1', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:23:48Z', 'updated_at': '2021-12-08T11:23:59Z', 'revision_number': 2, 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'gw_port_host': None, '_interfaces': [{'id': '87f71867-939e-4448-878f-26bc78d852dc', 'name': '', 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'mac_address': 'fa:16:3e:a8:9f:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '49734544-e5a8-4e6b-97e0-f65965989882', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2446cdbc-ba1d-4ad5-b4ea-8577435adf22', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:23:59Z', 'updated_at': '2021-12-08T11:24:02Z', 'revision_number': 4, 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'subnets': [{'id': '2446cdbc-ba1d-4ad5-b4ea-8577435adf22', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'fa0fa68f-abb6-42a8-a7a1-1cf35392e68b'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:24:02.428493 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-51a84f24-108b-4c97-ae69-78f4b1fbf41e None None] For port 87f71867-939e-4448-878f-26bc78d852dc, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=87f71867-939e-4448-878f-26bc78d852dc,segment=NetworkSegment(436f621c-e532-4526-ad49-fcbdc9585a32),segment_id=436f621c-e532-4526-ad49-fcbdc9585a32)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:24:02.432410 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-51a84f24-108b-4c97-ae69-78f4b1fbf41e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:02.448207 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ed033d0-2e76-471d-8fae-6462086bdab4 None None] The sync data for ids ['49734544-e5a8-4e6b-97e0-f65965989882'] in dv-cinder-819778-3-iscsi is: [{'id': '49734544-e5a8-4e6b-97e0-f65965989882', 'name': 'router1', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:23:48Z', 'updated_at': '2021-12-08T11:23:59Z', 'revision_number': 2, 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'gw_port_host': None, '_interfaces': [{'id': '87f71867-939e-4448-878f-26bc78d852dc', 'name': '', 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'mac_address': 'fa:16:3e:a8:9f:74', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '49734544-e5a8-4e6b-97e0-f65965989882', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2446cdbc-ba1d-4ad5-b4ea-8577435adf22', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:23:59Z', 'updated_at': '2021-12-08T11:24:02Z', 'revision_number': 4, 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'subnets': [{'id': '2446cdbc-ba1d-4ad5-b4ea-8577435adf22', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'fa0fa68f-abb6-42a8-a7a1-1cf35392e68b'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:24:02.483960 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51a84f24-108b-4c97-ae69-78f4b1fbf41e None None] Pushing event updated for resources: {'Port': ['ID=87f71867-939e-4448-878f-26bc78d852dc,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:24:02.988620 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 47590) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:24:03.100695 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a4b833d-6089-4962-9999-244c0efc4d4e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:24:03.102127 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-5a4b833d-6089-4962-9999-244c0efc4d4e admin admin] 10.222.0.66 "GET /v2.0/networks/d7cb3021-649a-44ca-b3a1-005b3941164e HTTP/1.1" status: 200 len: 842 time: 0.1124549 Dec 08 11:24:03.112508 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-0c454c8e-7429-4745-af72-14a3f7d89d2b admin admin] Request body: {'subnet': {'ip_version': 4, 'gateway_ip': '172.27.2.1', 'cidr': '172.27.2.0/24', 'name': 'public-subnet', 'enable_dhcp': False, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:24:03.136741 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c454c8e-7429-4745-af72-14a3f7d89d2b admin admin] Made reservation on behalf of b2cbded7915940edb7942bc90cb927db for: {'subnet': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:24:03.138996 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0c454c8e-7429-4745-af72-14a3f7d89d2b admin admin] Publish callbacks [] for subnet, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:03.435786 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.objects.ports [None req-0c454c8e-7429-4745-af72-14a3f7d89d2b admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102318) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 08 11:24:03.436203 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0c454c8e-7429-4745-af72-14a3f7d89d2b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for subnet, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:03.490525 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c454c8e-7429-4745-af72-14a3f7d89d2b admin admin] Pushing event updated for resources: {'Subnet': ['ID=d3c85f21-b354-4935-be9d-64f27cdb4486,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:24:03.499009 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c454c8e-7429-4745-af72-14a3f7d89d2b admin admin] Checking segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:24:03.499360 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c454c8e-7429-4745-af72-14a3f7d89d2b admin admin] Network hostable DHCP agents. Network: d7cb3021-649a-44ca-b3a1-005b3941164e, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102318) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:24:03.520333 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c454c8e-7429-4745-af72-14a3f7d89d2b admin admin] Network d7cb3021-649a-44ca-b3a1-005b3941164e is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102318) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:24:03.530525 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-0c454c8e-7429-4745-af72-14a3f7d89d2b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, d7cb3021-649a-44ca-b3a1-005b3941164e) {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:24:03.535097 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c454c8e-7429-4745-af72-14a3f7d89d2b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:24:03.535734 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0c454c8e-7429-4745-af72-14a3f7d89d2b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:03.542306 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0670cf39-71ae-472f-a6be-37ee7b61469b None None] Network d7cb3021-649a-44ca-b3a1-005b3941164e requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:24:03.553796 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-0c454c8e-7429-4745-af72-14a3f7d89d2b admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4451175 Dec 08 11:24:03.664630 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6adaec03-5d35-4215-b863-cee4e969afc7 None None] Network d7cb3021-649a-44ca-b3a1-005b3941164e requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:24:06.033188 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 47598) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:24:06.172371 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-f8bda9ac-e860-4d19-91ce-18395a50caaf admin admin] 10.222.0.66 "GET /v2.0/routers/49734544-e5a8-4e6b-97e0-f65965989882 HTTP/1.1" status: 200 len: 710 time: 0.1379704 Dec 08 11:24:06.263512 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0257d404-5c71-46dd-acc6-0eb0d420febe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:24:06.271404 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-0257d404-5c71-46dd-acc6-0eb0d420febe admin admin] 10.222.0.66 "GET /v2.0/networks/d7cb3021-649a-44ca-b3a1-005b3941164e HTTP/1.1" status: 200 len: 886 time: 0.0866318 Dec 08 11:24:06.275546 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:24:06.520731 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:06.832811 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:06.904125 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:07.010723 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Allocated IP 172.27.2.198 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/a7c463cd-a133-4fb0-9604-a5343b29334e) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:24:07.116372 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:07.148828 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:07.184894 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:24:07.190568 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:24:07.197922 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:24:07.200651 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Pushing event updated for resources: {'Port': ['ID=a7c463cd-a133-4fb0-9604-a5343b29334e,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:24:07.434851 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:07.628252 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-7889674', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-7895289', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-32142'] for router, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:07.631673 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7889773', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-7889667', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-7889684', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-7895282'] for router, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:07.736746 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Router 49734544-e5a8-4e6b-97e0-f65965989882 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:24:07.843114 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:24:07.848196 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] Publish callbacks [] for router, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:07.849613 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-28ac9efe-4114-4d21-a9f8-1e6438abe526 admin admin] 10.222.0.66 "PUT /v2.0/routers/49734544-e5a8-4e6b-97e0-f65965989882 HTTP/1.1" status: 200 len: 890 time: 1.5774965 Dec 08 11:24:09.618497 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Sync routers for ids ['49734544-e5a8-4e6b-97e0-f65965989882'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:24:09.630019 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Routers {'49734544-e5a8-4e6b-97e0-f65965989882'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:24:09.630713 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:23:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['49734544-e5a8-4e6b-97e0-f65965989882'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:24:09.834188 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Set router 49734544-e5a8-4e6b-97e0-f65965989882 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:24:09.909487 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 87f71867-939e-4448-878f-26bc78d852dc up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:24:10.165547 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 87f71867-939e-4448-878f-26bc78d852dc triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:24:10.165903 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:10.413010 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49734544-e5a8-4e6b-97e0-f65965989882', 'name': 'router1', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': 'a7c463cd-a133-4fb0-9604-a5343b29334e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:23:48Z', 'updated_at': '2021-12-08T11:24:07Z', 'revision_number': 4, 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'gw_port': {'id': 'a7c463cd-a133-4fb0-9604-a5343b29334e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:a3:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '49734544-e5a8-4e6b-97e0-f65965989882', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:24:06Z', 'updated_at': '2021-12-08T11:24:07Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '87f71867-939e-4448-878f-26bc78d852dc', 'name': '', 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'mac_address': 'fa:16:3e:a8:9f:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49734544-e5a8-4e6b-97e0-f65965989882', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2446cdbc-ba1d-4ad5-b4ea-8577435adf22', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:23:59Z', 'updated_at': '2021-12-08T11:24:02Z', 'revision_number': 5, 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'subnets': [{'id': '2446cdbc-ba1d-4ad5-b4ea-8577435adf22', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'fa0fa68f-abb6-42a8-a7a1-1cf35392e68b'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:24:10.465227 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Checking router: 49734544-e5a8-4e6b-97e0-f65965989882 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:24:10.465590 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Updating router 49734544-e5a8-4e6b-97e0-f65965989882 port a7c463cd-a133-4fb0-9604-a5343b29334e binding host dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:24:10.480218 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 47610) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:24:10.512457 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:10.597776 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-fd51d3b5-4d6a-48cc-85ee-f331d0eaf0fa admin admin] 10.222.0.66 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1163511 Dec 08 11:24:10.857080 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Publish callbacks [] for port, precommit_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:10.863086 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:10.922927 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Attempting to bind port a7c463cd-a133-4fb0-9604-a5343b29334e on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:24:10.923304 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Attempting to bind port a7c463cd-a133-4fb0-9604-a5343b29334e by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:24:10.923669 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Attempting to bind port a7c463cd-a133-4fb0-9604-a5343b29334e on network d7cb3021-649a-44ca-b3a1-005b3941164e {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:24:10.925525 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a3691c-20b6-46ac-9dc6-f06844017f82 None None] Pushing event updated for resources: {'Port': ['ID=a7c463cd-a133-4fb0-9604-a5343b29334e,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:24:10.931875 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 23, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:24:10.932798 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Checking segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:24:10.932798 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:10.933021 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Bound using segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:24:10.933519 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Bound port: a7c463cd-a133-4fb0-9604-a5343b29334e, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:24:10.933919 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:10.981995 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] For port a7c463cd-a133-4fb0-9604-a5343b29334e, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:24:10.985496 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] For port a7c463cd-a133-4fb0-9604-a5343b29334e, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=a7c463cd-a133-4fb0-9604-a5343b29334e,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:24:10.990978 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:11.048296 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Routers {'49734544-e5a8-4e6b-97e0-f65965989882'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:24:11.048427 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:23:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['49734544-e5a8-4e6b-97e0-f65965989882'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:24:11.053210 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a3691c-20b6-46ac-9dc6-f06844017f82 None None] Pushing event updated for resources: {'Port': ['ID=a7c463cd-a133-4fb0-9604-a5343b29334e,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:24:11.161656 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] Set router 49734544-e5a8-4e6b-97e0-f65965989882 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:24:11.376169 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49734544-e5a8-4e6b-97e0-f65965989882', 'name': 'router1', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': 'a7c463cd-a133-4fb0-9604-a5343b29334e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:23:48Z', 'updated_at': '2021-12-08T11:24:07Z', 'revision_number': 4, 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'gw_port': {'id': 'a7c463cd-a133-4fb0-9604-a5343b29334e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:a3:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '49734544-e5a8-4e6b-97e0-f65965989882', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:24:06Z', 'updated_at': '2021-12-08T11:24:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '87f71867-939e-4448-878f-26bc78d852dc', 'name': '', 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'mac_address': 'fa:16:3e:a8:9f:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49734544-e5a8-4e6b-97e0-f65965989882', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2446cdbc-ba1d-4ad5-b4ea-8577435adf22', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:23:59Z', 'updated_at': '2021-12-08T11:24:02Z', 'revision_number': 5, 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'subnets': [{'id': '2446cdbc-ba1d-4ad5-b4ea-8577435adf22', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'fa0fa68f-abb6-42a8-a7a1-1cf35392e68b'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:24:11.402562 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4b2a1a1e-210a-4f67-b0cd-06125d6b69b5 None None] The sync data for ids ['49734544-e5a8-4e6b-97e0-f65965989882'] in dv-cinder-819778-3-iscsi is: [{'id': '49734544-e5a8-4e6b-97e0-f65965989882', 'name': 'router1', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.198'}], 'enable_snat': True}, 'gw_port_id': 'a7c463cd-a133-4fb0-9604-a5343b29334e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:23:48Z', 'updated_at': '2021-12-08T11:24:07Z', 'revision_number': 4, 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'gw_port': {'id': 'a7c463cd-a133-4fb0-9604-a5343b29334e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:a3:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '49734544-e5a8-4e6b-97e0-f65965989882', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.198', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:24:06Z', 'updated_at': '2021-12-08T11:24:10Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '87f71867-939e-4448-878f-26bc78d852dc', 'name': '', 'network_id': '84a89399-8902-4580-9fe7-2581eae0be73', 'tenant_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'mac_address': 'fa:16:3e:a8:9f:74', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49734544-e5a8-4e6b-97e0-f65965989882', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '2446cdbc-ba1d-4ad5-b4ea-8577435adf22', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:23:59Z', 'updated_at': '2021-12-08T11:24:02Z', 'revision_number': 5, 'project_id': '3fc95dfb2d714098b7ddd3e4e4eda6e6', 'subnets': [{'id': '2446cdbc-ba1d-4ad5-b4ea-8577435adf22', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'fa0fa68f-abb6-42a8-a7a1-1cf35392e68b'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:24:11.913634 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device a7c463cd-a133-4fb0-9604-a5343b29334e up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:24:11.980285 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port a7c463cd-a133-4fb0-9604-a5343b29334e triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:24:11.980996 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:12.064664 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:12.085914 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port a7c463cd-a133-4fb0-9604-a5343b29334e, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=a7c463cd-a133-4fb0-9604-a5343b29334e,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:24:12.089799 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:12.139384 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=a7c463cd-a133-4fb0-9604-a5343b29334e,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:24:13.876274 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device a7c463cd-a133-4fb0-9604-a5343b29334e up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:24:13.938378 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port a7c463cd-a133-4fb0-9604-a5343b29334e triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:24:13.938749 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:18.786252 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 5 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:24:22.428181 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b1a05aef-b4cc-4be2-8775-34d11bb142a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:24.654663 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0f45f292-4060-49cc-8e04-036b4e17bb06 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:25.706992 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:27.078736 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:28.076119 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:52.454873 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-c3dc3edb-1037-4975-80e5-60e7ce7f4212 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:54.733281 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-ff49c699-befa-4a98-9b91-9848606bae4b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:55.712779 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:55.784706 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 5 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:24:57.064340 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:24:58.080508 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:22.427819 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2e350829-658a-4d9c-898b-39816c8c08b5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:24.658091 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0619529e-bbbf-4b2c-a3fd-d0ab3a03c485 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:25.713533 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:27.067735 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:28.086605 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:32.713532 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48094) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:25:32.776349 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.pecan_wsgi.hooks.translation [None req-742bc9b7-ac97-4e62-98ae-0d99504c9f85 admin admin] GET failed (client error): The resource could not be found. Dec 08 11:25:32.777797 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-742bc9b7-ac97-4e62-98ae-0d99504c9f85 admin admin] 10.222.0.66 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0632045 Dec 08 11:25:32.783281 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 5 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:25:33.013705 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9477df3-4694-422b-b342-8f8e941cdb63 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:33.015096 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-b9477df3-4694-422b-b342-8f8e941cdb63 admin admin] 10.222.0.66 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.2321749 Dec 08 11:25:35.384166 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48104) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:25:35.474365 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85cca7c3-17c2-471a-8d32-744cd91d5f59 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:35.475698 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-85cca7c3-17c2-471a-8d32-744cd91d5f59 admin admin] 10.222.0.66 "GET /v2.0/subnets/2446cdbc-ba1d-4ad5-b4ea-8577435adf22 HTTP/1.1" status: 200 len: 849 time: 0.0905509 Dec 08 11:25:35.485863 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:25:35.572686 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Publish callbacks [] for subnet, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:35.713002 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8729986960833'] for subnet, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:35.743561 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:35.743672 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:35.745347 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] 10.222.0.66 "PUT /v2.0/subnets/2446cdbc-ba1d-4ad5-b4ea-8577435adf22 HTTP/1.1" status: 200 len: 868 time: 0.2633410 Dec 08 11:25:35.746643 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca574e9c-9b92-4b6f-b71f-16e953ffb7b6 None None] Network 84a89399-8902-4580-9fe7-2581eae0be73 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:25:35.765963 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Pushing event updated for resources: {'Subnet': ['ID=2446cdbc-ba1d-4ad5-b4ea-8577435adf22,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:25:35.774132 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:25:35.774505 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:25:35.774846 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:25:35.775182 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:25:35.775523 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:25:35.775840 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:25:35.776185 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:25:35.776517 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:25:35.776862 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:25:35.777231 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:25:35.777568 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:25:35.777890 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:25:35.778209 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b918d1d2-9fa8-41c9-89cf-4ff4e739a95d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:25:36.131982 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-824eb2e8-1e78-40d4-821b-e084e0eb8a93 None None] Provisioning complete for port 87f71867-939e-4448-878f-26bc78d852dc triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:25:36.132355 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-824eb2e8-1e78-40d4-821b-e084e0eb8a93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:36.218149 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-824eb2e8-1e78-40d4-821b-e084e0eb8a93 None None] Provisioning complete for port 0613ba11-310a-4ccc-8f4f-fd21bb1f8a73 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:25:36.218443 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-824eb2e8-1e78-40d4-821b-e084e0eb8a93 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:38.156653 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48112) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:25:38.349993 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a89ac722-f0bf-492a-8842-0b014f3a59ca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:38.350464 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a89ac722-f0bf-492a-8842-0b014f3a59ca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:38.351983 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-a89ac722-f0bf-492a-8842-0b014f3a59ca admin admin] 10.222.0.66 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1944020 Dec 08 11:25:40.801829 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48120) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:25:40.938451 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98b8bcfb-b7cf-4440-8971-b953dfb7bbc0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:40.938916 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-98b8bcfb-b7cf-4440-8971-b953dfb7bbc0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:40.940446 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-98b8bcfb-b7cf-4440-8971-b953dfb7bbc0 admin admin] 10.222.0.66 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1376832 Dec 08 11:25:43.321517 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48128) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:25:43.451638 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83af8e1f-3173-4ee6-af8f-6d852978bf2d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:43.452980 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-83af8e1f-3173-4ee6-af8f-6d852978bf2d admin admin] 10.222.0.66 "GET /v2.0/networks/84a89399-8902-4580-9fe7-2581eae0be73 HTTP/1.1" status: 200 len: 869 time: 0.1305211 Dec 08 11:25:45.866608 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48136) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:25:45.987421 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1fff7334-1a64-44e1-96aa-4ff7fa9c6750 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:45.988766 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-1fff7334-1a64-44e1-96aa-4ff7fa9c6750 admin admin] 10.222.0.66 "GET /v2.0/networks/d7cb3021-649a-44ca-b3a1-005b3941164e HTTP/1.1" status: 200 len: 886 time: 0.1211874 Dec 08 11:25:48.382019 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48144) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:25:48.506105 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3721896-dba4-4e40-9fba-26bc93c98ef7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:48.506552 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3721896-dba4-4e40-9fba-26bc93c98ef7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:48.508052 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-d3721896-dba4-4e40-9fba-26bc93c98ef7 admin admin] 10.222.0.66 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1250665 Dec 08 11:25:50.874413 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48152) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:25:50.963244 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d5355c2-33f8-454c-9539-43042e379739 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:50.963703 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d5355c2-33f8-454c-9539-43042e379739 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:50.965234 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-1d5355c2-33f8-454c-9539-43042e379739 admin admin] 10.222.0.66 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0898430 Dec 08 11:25:52.430136 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e25b42aa-9221-400b-bfc3-f74c520c2ef7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:53.356197 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48160) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:25:53.446265 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b449704-3d69-48a4-9897-8393660dc529 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:53.447598 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-7b449704-3d69-48a4-9897-8393660dc529 admin admin] 10.222.0.66 "GET /v2.0/subnets/2446cdbc-ba1d-4ad5-b4ea-8577435adf22 HTTP/1.1" status: 200 len: 868 time: 0.0899272 Dec 08 11:25:54.659378 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-c9e53a06-d09f-4eca-b2a9-64f9237172f1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:55.717128 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:55.818677 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48168) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:25:55.906499 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af1a2f96-7171-478d-8ed7-0b813c6f4eca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:25:55.907830 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-af1a2f96-7171-478d-8ed7-0b813c6f4eca admin admin] 10.222.0.66 "GET /v2.0/subnets/d3c85f21-b354-4935-be9d-64f27cdb4486 HTTP/1.1" status: 200 len: 816 time: 0.0882099 Dec 08 11:25:57.073993 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:25:58.089818 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:09.782176 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 5 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:26:20.614890 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48222) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:26:20.662654 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [None req-7c260bc8-1a49-4d1e-92dc-c7e776c5b1e9 admin admin] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102318) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:26:20.663644 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-7c260bc8-1a49-4d1e-92dc-c7e776c5b1e9 admin admin] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0478177 Dec 08 11:26:22.432756 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2d3ba7c8-00b2-48f8-b7f5-5c7035057f80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:23.133731 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48230) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:26:23.192366 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.pecan_wsgi.hooks.translation [None req-119deaa2-fce0-4d13-b26d-3cab79de7656 admin admin] GET failed (client error): The resource could not be found. Dec 08 11:26:23.193649 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-119deaa2-fce0-4d13-b26d-3cab79de7656 admin admin] 10.222.0.66 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0589809 Dec 08 11:26:23.276923 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e52db57e-fa42-4d59-ab82-e54a137224a7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:26:23.278479 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-e52db57e-fa42-4d59-ab82-e54a137224a7 admin admin] 10.222.0.66 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.0803916 Dec 08 11:26:24.662933 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-4ecbe4c5-dcc3-4e1a-b888-60846a0f61d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:25.647044 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48238) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:26:25.693034 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-864e026a-0870-484f-b81f-9f352edff35f admin admin] Request body: {'network': {'name': 'shared', 'shared': True, 'admin_state_up': True}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:26:25.713714 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-864e026a-0870-484f-b81f-9f352edff35f admin admin] Made reservation on behalf of b2cbded7915940edb7942bc90cb927db for: {'network': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:26:25.716310 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-864e026a-0870-484f-b81f-9f352edff35f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:25.721253 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:25.744708 dv-cinder-819778-3-iscsi neutron-server[102318]: WARNING neutron.services.revisions.revision_plugin [None req-864e026a-0870-484f-b81f-9f352edff35f admin admin] Could not find related network for resource to bump revision. Dec 08 11:26:25.758919 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-864e026a-0870-484f-b81f-9f352edff35f admin admin] vlan segment allocate from pool success with {'vlan_id': 299, 'physical_network': 'physnet1'} {{(pid=102318) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:26:25.768606 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-864e026a-0870-484f-b81f-9f352edff35f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:25.768942 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.segments_db [None req-864e026a-0870-484f-b81f-9f352edff35f admin admin] Added segment e9f215c2-bfb7-4c9c-9387-63241407ac7e of type vlan for network 7df8d427-89be-46db-a2a5-7e3b3b0f889a Dec 08 11:26:25.813665 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-864e026a-0870-484f-b81f-9f352edff35f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:25.836536 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-864e026a-0870-484f-b81f-9f352edff35f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:25.837484 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-864e026a-0870-484f-b81f-9f352edff35f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:26:25.838080 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-864e026a-0870-484f-b81f-9f352edff35f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:25.885375 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-864e026a-0870-484f-b81f-9f352edff35f admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2372243 Dec 08 11:26:25.897715 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-864e026a-0870-484f-b81f-9f352edff35f admin admin] Pushing event updated for resources: {'Network': ['ID=7df8d427-89be-46db-a2a5-7e3b3b0f889a,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:26:25.909838 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network 7df8d427-89be-46db-a2a5-7e3b3b0f889a details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:26:27.078138 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:28.096221 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:28.304493 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48246) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:26:28.363435 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.pecan_wsgi.hooks.translation [None req-71198c60-0bd2-4c48-b351-f17972fc5678 admin admin] GET failed (client error): The resource could not be found. Dec 08 11:26:28.364695 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-71198c60-0bd2-4c48-b351-f17972fc5678 admin admin] 10.222.0.66 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0592508 Dec 08 11:26:28.435335 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c76b09be-09e4-4f03-a75e-38b1501d647d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:26:28.436749 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-c76b09be-09e4-4f03-a75e-38b1501d647d admin admin] 10.222.0.66 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0674651 Dec 08 11:26:28.446579 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-d03f662a-e838-494f-a143-42a09dcef838 admin admin] Request body: {'subnet': {'ip_version': 4, 'description': 'shared-subnet', 'cidr': '192.168.233.0/24', 'name': 'shared-subnet', 'network_id': '7df8d427-89be-46db-a2a5-7e3b3b0f889a'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:26:28.466432 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d03f662a-e838-494f-a143-42a09dcef838 admin admin] Made reservation on behalf of b2cbded7915940edb7942bc90cb927db for: {'subnet': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:26:28.468633 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d03f662a-e838-494f-a143-42a09dcef838 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:28.720575 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d03f662a-e838-494f-a143-42a09dcef838 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for subnet, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:28.771470 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d03f662a-e838-494f-a143-42a09dcef838 admin admin] Pushing event updated for resources: {'Subnet': ['ID=12e62f95-2153-4a0a-85cc-741571dc715a,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:26:28.781788 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d03f662a-e838-494f-a143-42a09dcef838 admin admin] Checking segment: {'id': 'e9f215c2-bfb7-4c9c-9387-63241407ac7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 299, 'network_id': '7df8d427-89be-46db-a2a5-7e3b3b0f889a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:26:28.782145 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d03f662a-e838-494f-a143-42a09dcef838 admin admin] Network hostable DHCP agents. Network: 7df8d427-89be-46db-a2a5-7e3b3b0f889a, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102318) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:26:28.798097 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d03f662a-e838-494f-a143-42a09dcef838 admin admin] Network 7df8d427-89be-46db-a2a5-7e3b3b0f889a is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102318) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:26:28.805969 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-d03f662a-e838-494f-a143-42a09dcef838 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, 7df8d427-89be-46db-a2a5-7e3b3b0f889a) {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:26:28.809983 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d03f662a-e838-494f-a143-42a09dcef838 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:26:28.810602 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d03f662a-e838-494f-a143-42a09dcef838 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:28.815176 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8794660-943c-4f37-9471-77e923135111 None None] Network 7df8d427-89be-46db-a2a5-7e3b3b0f889a requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:26:28.825769 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-d03f662a-e838-494f-a143-42a09dcef838 admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3824310 Dec 08 11:26:28.923699 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp49d6adb3-88e2-5e36-b97e-28b28be9cdf8-7df8d427-89be-46db-a2a5-7e3b3b0f889a', 'network_id': '7df8d427-89be-46db-a2a5-7e3b3b0f889a', 'project_id': 'b2cbded7915940edb7942bc90cb927db', 'fixed_ips': [{'subnet_id': '12e62f95-2153-4a0a-85cc-741571dc715a'}]}} from dv-cinder-819778-3-iscsi. {{(pid=102319) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 08 11:26:28.924635 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:29.166836 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.db_base_plugin_common [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Allocated IP 192.168.233.2 (7df8d427-89be-46db-a2a5-7e3b3b0f889a/12e62f95-2153-4a0a-85cc-741571dc715a/54c0d7d2-9e84-4b21-9213-d10b46cb493c) {{(pid=102319) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:26:29.311669 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Publish callbacks [] for port, precommit_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:29.317977 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:29.355341 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Network 7df8d427-89be-46db-a2a5-7e3b3b0f889a is already hosted by enough agents. {{(pid=102319) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:26:29.360052 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.base_scheduler [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Resources bound (agent type, host, resource id): {{(pid=102319) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:26:29.364707 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Received port after_create {{(pid=102319) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:26:29.371787 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Pushing event updated for resources: {'Port': ['ID=54c0d7d2-9e84-4b21-9213-d10b46cb493c,revision_number=1']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:26:29.381385 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:26:29.381750 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:26:29.382109 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:26:29.382445 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:26:29.382781 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:26:29.383102 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:26:29.383423 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:26:29.383742 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:26:29.384061 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:26:29.384393 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:26:29.384715 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:26:29.385054 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:26:29.385395 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:26:29.433328 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Attempting to bind port 54c0d7d2-9e84-4b21-9213-d10b46cb493c on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:26:29.433700 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Attempting to bind port 54c0d7d2-9e84-4b21-9213-d10b46cb493c by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'e9f215c2-bfb7-4c9c-9387-63241407ac7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 299, 'network_id': '7df8d427-89be-46db-a2a5-7e3b3b0f889a'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:26:29.434066 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Attempting to bind port 54c0d7d2-9e84-4b21-9213-d10b46cb493c on network 7df8d427-89be-46db-a2a5-7e3b3b0f889a {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:26:29.439423 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 26, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:26:29.440069 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Checking segment: {'id': 'e9f215c2-bfb7-4c9c-9387-63241407ac7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 299, 'network_id': '7df8d427-89be-46db-a2a5-7e3b3b0f889a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:26:29.440650 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:29.441045 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Bound using segment: {'id': 'e9f215c2-bfb7-4c9c-9387-63241407ac7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 299, 'network_id': '7df8d427-89be-46db-a2a5-7e3b3b0f889a'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:26:29.441555 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Bound port: 54c0d7d2-9e84-4b21-9213-d10b46cb493c, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e9f215c2-bfb7-4c9c-9387-63241407ac7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 299, 'network_id': '7df8d427-89be-46db-a2a5-7e3b3b0f889a'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:26:29.441953 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:29.506422 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] For port 54c0d7d2-9e84-4b21-9213-d10b46cb493c, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:26:29.509778 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] For port 54c0d7d2-9e84-4b21-9213-d10b46cb493c, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=54c0d7d2-9e84-4b21-9213-d10b46cb493c,segment=NetworkSegment(e9f215c2-bfb7-4c9c-9387-63241407ac7e),segment_id=e9f215c2-bfb7-4c9c-9387-63241407ac7e)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:26:29.515901 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:29.572813 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d28a45a0-36df-4652-a39c-673df8e1b8dd None None] Pushing event updated for resources: {'Port': ['ID=54c0d7d2-9e84-4b21-9213-d10b46cb493c,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:26:29.986692 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 54c0d7d2-9e84-4b21-9213-d10b46cb493c up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:26:30.048964 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 54c0d7d2-9e84-4b21-9213-d10b46cb493c triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:26:30.049377 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:30.131693 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:30.169881 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port 54c0d7d2-9e84-4b21-9213-d10b46cb493c, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=54c0d7d2-9e84-4b21-9213-d10b46cb493c,segment=NetworkSegment(e9f215c2-bfb7-4c9c-9387-63241407ac7e),segment_id=e9f215c2-bfb7-4c9c-9387-63241407ac7e)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:26:30.175238 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:30.227740 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=54c0d7d2-9e84-4b21-9213-d10b46cb493c,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:26:30.412329 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44342454-be71-401b-a60b-e3867bb1c9b3 None None] Network 7df8d427-89be-46db-a2a5-7e3b3b0f889a requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:26:30.475452 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-7edc158a-2569-4b64-acc6-45c80063b29d None None] Provisioning complete for port 54c0d7d2-9e84-4b21-9213-d10b46cb493c triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:26:30.475749 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-7edc158a-2569-4b64-acc6-45c80063b29d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:30.917113 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-5da486ac-ef9d-4832-8ec8-3ddb3d416770 None None] Provisioning complete for port 54c0d7d2-9e84-4b21-9213-d10b46cb493c triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:26:30.917503 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-5da486ac-ef9d-4832-8ec8-3ddb3d416770 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:31.960325 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 54c0d7d2-9e84-4b21-9213-d10b46cb493c up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:26:32.012906 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 54c0d7d2-9e84-4b21-9213-d10b46cb493c triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:26:32.013304 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:46.781239 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 5 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:26:52.435998 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-babbda64-837e-4100-8e6e-319525a495bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:54.665661 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-48cb01f6-bb01-494e-9425-e0a59319cb9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:55.721817 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:57.082435 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:26:58.092471 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:22.436922 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1c90fff0-9a34-4ca7-90e8-f9d28fad0915 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:23.780215 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 5 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:27:24.670175 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-7ef050e9-ec66-44f5-b3e6-0306be3fbefc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:25.724255 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:27.086986 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:28.096938 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:44.527656 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48290) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:27:44.533434 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [None req-322cd5c8-50f7-4075-94d9-4c266946f305 tempest-verify_tempest_config-116457066 tempest-verify_tempest_config-116457066-project] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102318) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:27:44.534421 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-322cd5c8-50f7-4075-94d9-4c266946f305 tempest-verify_tempest_config-116457066 tempest-verify_tempest_config-116457066-project] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0057769 Dec 08 11:27:44.821073 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 48308) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:27:44.923593 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:45.000351 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:45.003743 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:45.054954 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=1d4dd915ef664f52b214b5075e1551b1&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2325068 Dec 08 11:27:45.056314 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=011fd070-bf15-4eda-b561-bd5e95a986eb,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:27:45.057821 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48314) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:27:45.064124 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.064491 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.064837 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.065196 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.065535 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.065903 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.066195 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.066522 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.066858 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.067198 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.067520 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.067840 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.068155 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37c736fb-7359-45f2-b623-eef746af39c1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.113894 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:45.134886 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:45.231309 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:45.233871 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:45.235102 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/011fd070-bf15-4eda-b561-bd5e95a986eb HTTP/1.1" status: 204 len: 168 time: 0.1752152 Dec 08 11:27:45.242953 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=011fd070-bf15-4eda-b561-bd5e95a986eb,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:27:45.250125 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.250545 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.250836 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.251169 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.251493 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.251816 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.252154 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.252482 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.252816 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.253141 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.253479 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.253796 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:45.254109 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bb1ddc80-1e86-486d-8ddc-1e8fd00c01c1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:27:52.438992 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-cbe22854-68ed-4b21-9278-95837ee5c5c9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:54.673368 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-ff4ffc1b-1889-4d25-9828-f7f9994f2601 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:55.725638 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:57.087084 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:27:58.099154 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:28:00.779266 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 5 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:28:22.440544 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-06f5f422-1890-4109-b384-622a766084f7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:28:24.674828 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-3e4af6d1-46b8-4f1e-9544-2b9653289c69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:28:25.728384 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:28:27.091847 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:28:28.100743 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:28:37.777776 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 5 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:28:52.440516 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-bd57dd5e-9f4c-4e66-819a-c15d03496fd2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:28:54.676169 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-83cbd347-1846-4e66-91f4-bf39c48c27ba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:28:55.731365 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:28:57.093105 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:28:58.103608 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:29:14.777017 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 5 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:29:17.544723 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-7896852'] for agent, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:29:22.442131 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-11846b25-5b41-4e0f-a33a-61b33d147433 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:29:24.678139 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b26d1e17-9ace-4ecd-88b2-2dc1a5cf415c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:29:25.734962 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:29:27.102410 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:29:28.107004 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:29:32.304047 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48386) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:29:32.406781 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-66056b11-bcdb-4054-a8ef-6ba4f521b6c1 admin admin] 10.222.0.66 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1016364 Dec 08 11:29:34.796631 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48396) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:29:34.850747 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-cda03144-93e6-4c90-91d8-0fcd445085dd admin admin] 10.222.0.66 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0530059 Dec 08 11:29:47.511905 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:29:51.776357 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:29:52.441833 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-8058f87a-a5ae-4620-8971-6c1173bb4dbf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:29:54.679235 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-c64049e5-82a7-43e7-8be3-0bf86dd91a41 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:29:55.738472 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:29:57.103913 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:29:58.109096 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:30:17.512557 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:30:22.442399 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-5e5a8564-0845-4b9d-9951-c4d62d47d1fc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:30:24.680212 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-c7cb3dac-dac2-4ff2-8c9e-73b52c95e3d2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:30:25.742606 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:30:27.106273 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:30:28.115188 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:30:28.776573 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:30:47.510778 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:30:52.443003 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e1a12ddd-da04-45fa-8de0-1e8309b753ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:30:54.682523 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fe236d40-d999-42d2-b962-a3e9dd067629 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:30:55.745295 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:30:57.109549 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:30:58.117715 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.018243 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48586) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:04.229867 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48602) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:04.310776 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1635908517-network', 'tenant_id': '1770e8f8a0b34c0aa4adafccc2df6628'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:04.331699 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Made reservation on behalf of 1770e8f8a0b34c0aa4adafccc2df6628 for: {'network': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:04.334440 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.343928 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.431072 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.435624 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.459780 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:04.467645 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:04.468198 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:04.468725 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:04.469065 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:04.469430 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:04.469761 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:04.470086 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:04.470413 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:04.470738 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:04.471058 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:04.471379 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:04.471696 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:04.472011 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Tracked resource versions report: Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: pushed versions: Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: { 'AddressGroup': {'1.2'}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'ConntrackHelper': {'1.0'}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'LocalIPAssociation': {'1.0'}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Log': {'1.0'}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Network': {'1.1'}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Port': {'1.7'}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'PortForwarding': {'1.2'}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'QosPolicy': {'1.10'}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'SecurityGroup': {'1.5'}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'SecurityGroupRule': {'1.2'}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'SubPort': {'1.0'}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Subnet': {'1.1'}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Trunk': {'1.1'}} Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: consumer versions: Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: { DHCP agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: HyperV agent@hv-cinder-81977: {}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: L3 agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: Metadata agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: Metering agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: Open vSwitch agent@dv-cinder-819778-3-iscsi: { 'AddressGroup': '1.2', Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'ConntrackHelper': '1.0', Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'LocalIPAssociation': '1.0', Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Log': '1.0', Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Network': '1.1', Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Port': '1.7', Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'PortForwarding': '1.2', Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'QosPolicy': '1.10', Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'SecurityGroup': '1.5', Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'SecurityGroupRule': '1.2', Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'SubPort': '1.0', Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Subnet': '1.1', Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: 'Trunk': '1.1'}} Dec 08 11:31:04.473076 dv-cinder-819778-3-iscsi neutron-server[102318]: {{(pid=102318) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 08 11:31:04.481230 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] vlan segment allocate from pool success with {'vlan_id': 295, 'physical_network': 'physnet1'} {{(pid=102318) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:31:04.491810 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.492154 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.segments_db [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Added segment 5be28b76-0677-4ab9-a950-5242cff71605 of type vlan for network d0180d44-2173-43bc-b3b2-67db13c39ea0 Dec 08 11:31:04.534219 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.554747 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-17956570-network', 'tenant_id': '34e91fcdeaf64d10965b2770cbeab690'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:04.579638 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Made reservation on behalf of 34e91fcdeaf64d10965b2770cbeab690 for: {'network': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:04.582431 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.585587 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.587060 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:04.587719 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.604164 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.626378 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.6070585 Dec 08 11:31:04.629347 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 48632) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:04.635245 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Request body: {'subnet': {'network_id': 'd0180d44-2173-43bc-b3b2-67db13c39ea0', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1635908517-subnet', 'tenant_id': '1770e8f8a0b34c0aa4adafccc2df6628', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:04.658498 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Made reservation on behalf of 1770e8f8a0b34c0aa4adafccc2df6628 for: {'subnet': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:04.663505 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Publish callbacks [] for subnet, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.709188 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6649430a-0d39-4fe6-8cd1-3213306317e0 admin admin] Pushing event updated for resources: {'Network': ['ID=d0180d44-2173-43bc-b3b2-67db13c39ea0,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:04.722441 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network d0180d44-2173-43bc-b3b2-67db13c39ea0 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:31:04.746374 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.751908 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.783256 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd345d28-0a71-431c-a740-203ea22e74a5,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:04.795220 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] vlan segment allocate from pool success with {'vlan_id': 277, 'physical_network': 'physnet1'} {{(pid=102318) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:31:04.809341 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.809879 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.segments_db [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Added segment 6591c62b-7ba0-41ad-8d14-59c272604f28 of type vlan for network 6e4bda07-1ae1-4be4-bf28-e94211f51919 Dec 08 11:31:04.875140 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.904363 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.905366 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:04.905991 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.932005 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for subnet, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:04.999701 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.7686126 Dec 08 11:31:05.001263 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48648) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:05.009694 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-ed6e91a9-0286-43e2-ab54-2ea75a09ff3d admin admin] Request body: {'subnet': {'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-17956570-subnet', 'tenant_id': '34e91fcdeaf64d10965b2770cbeab690', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:05.009879 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Pushing event updated for resources: {'Subnet': ['ID=2d9f9ed3-4577-43a0-80bf-cc86dab7d362,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:05.014880 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 48650) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:05.020122 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f88674fc-9c88-4bb7-b8f8-028b6ce97faa admin admin] Pushing event updated for resources: {'Network': ['ID=6e4bda07-1ae1-4be4-bf28-e94211f51919,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:05.027958 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Checking segment: {'id': '5be28b76-0677-4ab9-a950-5242cff71605', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': 'd0180d44-2173-43bc-b3b2-67db13c39ea0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:05.028314 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Network hostable DHCP agents. Network: d0180d44-2173-43bc-b3b2-67db13c39ea0, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102317) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:31:05.031008 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:05.031548 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:05.034037 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network 6e4bda07-1ae1-4be4-bf28-e94211f51919 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:31:05.041929 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:05.042510 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:05.043073 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:05.043485 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:05.043847 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:05.044335 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:05.047763 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed6e91a9-0286-43e2-ab54-2ea75a09ff3d admin admin] Made reservation on behalf of 34e91fcdeaf64d10965b2770cbeab690 for: {'subnet': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:05.049473 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:05.050656 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:05.051182 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:05.051535 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:05.051857 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:05.052103 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-ed6e91a9-0286-43e2-ab54-2ea75a09ff3d admin admin] Publish callbacks [] for subnet, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Tracked resource versions report: Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: pushed versions: Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: { 'AddressGroup': {'1.2'}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'ConntrackHelper': {'1.0'}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'LocalIPAssociation': {'1.0'}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Log': {'1.0'}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Network': {'1.1'}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Port': {'1.7'}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'PortForwarding': {'1.2'}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'QosPolicy': {'1.10'}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'SecurityGroup': {'1.5'}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'SecurityGroupRule': {'1.2'}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'SubPort': {'1.0'}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Subnet': {'1.1'}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Trunk': {'1.1'}} Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: consumer versions: Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: { DHCP agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: HyperV agent@hv-cinder-81977: {}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: L3 agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: Metadata agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: Metering agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: Open vSwitch agent@dv-cinder-819778-3-iscsi: { 'AddressGroup': '1.2', Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'ConntrackHelper': '1.0', Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'LocalIPAssociation': '1.0', Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Log': '1.0', Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Network': '1.1', Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Port': '1.7', Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'PortForwarding': '1.2', Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'QosPolicy': '1.10', Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'SecurityGroup': '1.5', Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'SecurityGroupRule': '1.2', Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'SubPort': '1.0', Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Subnet': '1.1', Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: 'Trunk': '1.1'}} Dec 08 11:31:05.055280 dv-cinder-819778-3-iscsi neutron-server[102317]: {{(pid=102317) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 08 11:31:05.072726 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 48656) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:05.081958 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Network d0180d44-2173-43bc-b3b2-67db13c39ea0 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102317) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:31:05.115850 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, d0180d44-2173-43bc-b3b2-67db13c39ea0) {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:05.120931 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:05.121576 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.151064 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-841138ba-81c7-4934-8839-d18ef25fd6ce admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.5206046 Dec 08 11:31:05.169796 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72154011-07fa-4e77-904c-ef274821a1c1 None None] Network d0180d44-2173-43bc-b3b2-67db13c39ea0 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:31:05.273178 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a34f97c-42e6-4dc1-85ef-9c7bd13552b2 None None] Network d0180d44-2173-43bc-b3b2-67db13c39ea0 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:31:05.310170 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-ed6e91a9-0286-43e2-ab54-2ea75a09ff3d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for subnet, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.355229 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-549518292-network', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:05.363582 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed6e91a9-0286-43e2-ab54-2ea75a09ff3d admin admin] Pushing event updated for resources: {'Subnet': ['ID=d6b1fb0e-d38f-47ca-a647-53b824c47e76,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:05.392534 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-237846723-network', 'tenant_id': '44406e332fd94f1a9dcd704577410a61'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:05.398794 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Made reservation on behalf of 9c60094b48d34489b46e92ae73d7e33a for: {'network': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:05.401584 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.403211 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed6e91a9-0286-43e2-ab54-2ea75a09ff3d admin admin] Checking segment: {'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:05.403820 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed6e91a9-0286-43e2-ab54-2ea75a09ff3d admin admin] Network hostable DHCP agents. Network: 6e4bda07-1ae1-4be4-bf28-e94211f51919, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102318) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:31:05.417489 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.424130 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ed6e91a9-0286-43e2-ab54-2ea75a09ff3d admin admin] Network 6e4bda07-1ae1-4be4-bf28-e94211f51919 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102318) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:31:05.441668 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-ed6e91a9-0286-43e2-ab54-2ea75a09ff3d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, 6e4bda07-1ae1-4be4-bf28-e94211f51919) {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:05.449696 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed6e91a9-0286-43e2-ab54-2ea75a09ff3d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:05.451010 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-ed6e91a9-0286-43e2-ab54-2ea75a09ff3d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.453917 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Made reservation on behalf of 44406e332fd94f1a9dcd704577410a61 for: {'network': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:05.455426 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-06e91911-6e68-4982-a32b-2fa723b93efd None None] Network 6e4bda07-1ae1-4be4-bf28-e94211f51919 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:31:05.456327 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.473521 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.474298 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-ed6e91a9-0286-43e2-ab54-2ea75a09ff3d admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.4693413 Dec 08 11:31:05.557805 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.569785 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.584029 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2c62509-864c-45f9-86cf-eeb75b2766ce None None] Network 6e4bda07-1ae1-4be4-bf28-e94211f51919 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:31:05.609810 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a75e13bf-0367-4e19-987a-3dc5a4bb7d78,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:05.629933 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] vlan segment allocate from pool success with {'vlan_id': 296, 'physical_network': 'physnet1'} {{(pid=102317) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:31:05.643405 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.643857 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.segments_db [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Added segment 432df489-4b9c-40d9-bda0-90c4bebb3b27 of type vlan for network 185aeb08-41ef-4fae-a420-33296f710850 Dec 08 11:31:05.703567 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.707885 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.723858 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.739991 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] vlan segment allocate from pool success with {'vlan_id': 278, 'physical_network': 'physnet1'} {{(pid=102317) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:31:05.771269 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.771714 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.segments_db [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Added segment 394a978e-a69b-4e58-ad01-1710ac7a878b of type vlan for network fd37a1fc-3614-462b-92a2-b41260c949a2 Dec 08 11:31:05.774148 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5844f054-16cb-4dc7-b4ab-715d3455ebb8,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:05.782444 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:31:05.810211 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.811148 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:05.811744 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.864850 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.882204 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.8661149 Dec 08 11:31:05.886740 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48688) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:05.894353 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-f868c1ec-2b5c-41b6-b127-652b6ed0a130 admin admin] Request body: {'subnet': {'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-549518292-subnet', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:05.927734 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6566f21-e58d-47a5-8ffc-c79f6f0231f7 admin admin] Pushing event updated for resources: {'Network': ['ID=185aeb08-41ef-4fae-a420-33296f710850,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:05.928793 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f868c1ec-2b5c-41b6-b127-652b6ed0a130 admin admin] Made reservation on behalf of 9c60094b48d34489b46e92ae73d7e33a for: {'subnet': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:05.940113 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network 185aeb08-41ef-4fae-a420-33296f710850 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:31:05.941095 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f868c1ec-2b5c-41b6-b127-652b6ed0a130 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.950688 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:05.951640 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:05.952240 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.110408 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 48700) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:06.141425 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48704) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:06.144601 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 1.0703037 Dec 08 11:31:06.149489 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-b6d2a93a-fa7e-4648-8735-64d8b99c41d0 admin admin] Request body: {'subnet': {'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-subnet', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:06.156329 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b43bfad-1276-490d-8ea8-746591d19d83 admin admin] Pushing event updated for resources: {'Network': ['ID=fd37a1fc-3614-462b-92a2-b41260c949a2,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:06.171181 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network fd37a1fc-3614-462b-92a2-b41260c949a2 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:31:06.254189 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b6d2a93a-fa7e-4648-8735-64d8b99c41d0 admin admin] Made reservation on behalf of 44406e332fd94f1a9dcd704577410a61 for: {'subnet': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:06.256946 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b6d2a93a-fa7e-4648-8735-64d8b99c41d0 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.304390 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f868c1ec-2b5c-41b6-b127-652b6ed0a130 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for subnet, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.392893 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f868c1ec-2b5c-41b6-b127-652b6ed0a130 admin admin] Pushing event updated for resources: {'Subnet': ['ID=40a584f7-ce77-4d89-87c2-4f3f589c6700,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:06.413345 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f868c1ec-2b5c-41b6-b127-652b6ed0a130 admin admin] Checking segment: {'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:06.413927 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f868c1ec-2b5c-41b6-b127-652b6ed0a130 admin admin] Network hostable DHCP agents. Network: 185aeb08-41ef-4fae-a420-33296f710850, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102318) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:31:06.464059 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-26e6edc0-775c-44f3-a525-a9b7d0fa5ef2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.480461 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f868c1ec-2b5c-41b6-b127-652b6ed0a130 admin admin] Network 185aeb08-41ef-4fae-a420-33296f710850 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102318) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:31:06.514340 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-f868c1ec-2b5c-41b6-b127-652b6ed0a130 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, 185aeb08-41ef-4fae-a420-33296f710850) {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:06.526388 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f868c1ec-2b5c-41b6-b127-652b6ed0a130 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:06.527647 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f868c1ec-2b5c-41b6-b127-652b6ed0a130 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.534850 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-314ba03f-bdab-4382-b5f9-d8af072d587a None None] Network 185aeb08-41ef-4fae-a420-33296f710850 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:31:06.550965 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b6d2a93a-fa7e-4648-8735-64d8b99c41d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for subnet, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.559127 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-26e6edc0-775c-44f3-a525-a9b7d0fa5ef2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.564675 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-26e6edc0-775c-44f3-a525-a9b7d0fa5ef2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.583142 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-f868c1ec-2b5c-41b6-b127-652b6ed0a130 admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6899941 Dec 08 11:31:06.588599 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 48726) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:06.593846 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:06.640050 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-26e6edc0-775c-44f3-a525-a9b7d0fa5ef2 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=598542930f474518a50a2736fad82034&name=default HTTP/1.1" status: 200 len: 2992 time: 0.5279150 Dec 08 11:31:06.644570 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48730) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:06.661893 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26e6edc0-775c-44f3-a525-a9b7d0fa5ef2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4cf47f13-1726-4947-9855-bd97cecfc137,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:06.681235 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7895423', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32171'] for router, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.687082 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7895279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7889720', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7925360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32176'] for router, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.706774 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b6d2a93a-fa7e-4648-8735-64d8b99c41d0 admin admin] Checking segment: {'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:06.707363 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6d2a93a-fa7e-4648-8735-64d8b99c41d0 admin admin] Network hostable DHCP agents. Network: fd37a1fc-3614-462b-92a2-b41260c949a2, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102318) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:31:06.733596 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a1c16e24-8394-4172-80d3-ff7c034a0178 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.740290 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp49d6adb3-88e2-5e36-b97e-28b28be9cdf8-185aeb08-41ef-4fae-a420-33296f710850', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700'}]}} from dv-cinder-819778-3-iscsi. {{(pid=102319) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 08 11:31:06.741383 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.775701 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.793049 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a1c16e24-8394-4172-80d3-ff7c034a0178 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.807212 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6d2a93a-fa7e-4648-8735-64d8b99c41d0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=62551f0b-3202-4a06-842d-a67bd8fa187b,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:06.848162 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6d2a93a-fa7e-4648-8735-64d8b99c41d0 admin admin] Network fd37a1fc-3614-462b-92a2-b41260c949a2 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102318) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:31:06.886036 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-b6d2a93a-fa7e-4648-8735-64d8b99c41d0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, fd37a1fc-3614-462b-92a2-b41260c949a2) {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:06.893367 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6d2a93a-fa7e-4648-8735-64d8b99c41d0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:06.896782 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b6d2a93a-fa7e-4648-8735-64d8b99c41d0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.900969 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab323837-e6be-49dc-8cfa-596f6bb52419 None None] Network fd37a1fc-3614-462b-92a2-b41260c949a2 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:31:06.933005 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-b6d2a93a-fa7e-4648-8735-64d8b99c41d0 admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.7848301 Dec 08 11:31:06.933567 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48742) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:06.948863 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:06.981411 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a1c16e24-8394-4172-80d3-ff7c034a0178 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.984177 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a1c16e24-8394-4172-80d3-ff7c034a0178 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:06.987782 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-a1c16e24-8394-4172-80d3-ff7c034a0178 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/4cf47f13-1726-4947-9855-bd97cecfc137 HTTP/1.1" status: 204 len: 168 time: 0.3395343 Dec 08 11:31:07.016076 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1c16e24-8394-4172-80d3-ff7c034a0178 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4cf47f13-1726-4947-9855-bd97cecfc137,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:07.025483 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7895423', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32171'] for router, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:07.026267 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7895279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7889720', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7925360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32176'] for router, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:07.110514 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:07.196110 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.db_base_plugin_common [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Allocated IP 172.20.0.2 (185aeb08-41ef-4fae-a420-33296f710850/40a584f7-ce77-4d89-87c2-4f3f589c6700/2f94307a-f496-4b83-80a6-634c4b525dde) {{(pid=102319) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:31:07.220143 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:07.395971 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Publish callbacks [] for port, precommit_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:07.407608 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:07.422928 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp49d6adb3-88e2-5e36-b97e-28b28be9cdf8-fd37a1fc-3614-462b-92a2-b41260c949a2', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'project_id': '44406e332fd94f1a9dcd704577410a61', 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b'}]}} from dv-cinder-819778-3-iscsi. {{(pid=102319) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 08 11:31:07.427844 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:07.516001 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:07.525723 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Network 185aeb08-41ef-4fae-a420-33296f710850 is already hosted by enough agents. {{(pid=102319) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:07.537966 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.base_scheduler [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Resources bound (agent type, host, resource id): {{(pid=102319) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:07.541993 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Received port after_create {{(pid=102319) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:31:07.558347 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Pushing event updated for resources: {'Port': ['ID=2f94307a-f496-4b83-80a6-634c4b525dde,revision_number=1']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:07.587506 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:07.588204 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:07.588729 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:07.589272 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:07.589800 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:07.590132 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:07.590461 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:07.591119 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:07.591778 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:07.592302 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:07.592793 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:07.593306 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:07.593861 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Tracked resource versions report: Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: pushed versions: Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: { 'AddressGroup': {'1.2'}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'ConntrackHelper': {'1.0'}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'LocalIPAssociation': {'1.0'}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Log': {'1.0'}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Network': {'1.1'}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Port': {'1.7'}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'PortForwarding': {'1.2'}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'QosPolicy': {'1.10'}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'SecurityGroup': {'1.5'}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'SecurityGroupRule': {'1.2'}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'SubPort': {'1.0'}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Subnet': {'1.1'}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Trunk': {'1.1'}} Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: consumer versions: Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: { DHCP agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: HyperV agent@hv-cinder-81977: {}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: L3 agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: Metadata agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: Metering agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: Open vSwitch agent@dv-cinder-819778-3-iscsi: { 'AddressGroup': '1.2', Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'ConntrackHelper': '1.0', Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'LocalIPAssociation': '1.0', Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Log': '1.0', Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Network': '1.1', Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Port': '1.7', Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'PortForwarding': '1.2', Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'QosPolicy': '1.10', Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'SecurityGroup': '1.5', Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'SecurityGroupRule': '1.2', Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'SubPort': '1.0', Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Subnet': '1.1', Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: 'Trunk': '1.1'}} Dec 08 11:31:07.595129 dv-cinder-819778-3-iscsi neutron-server[102319]: {{(pid=102319) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 08 11:31:07.659422 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48764) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:07.675296 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:07.703098 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Attempting to bind port 2f94307a-f496-4b83-80a6-634c4b525dde on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:31:07.703742 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Attempting to bind port 2f94307a-f496-4b83-80a6-634c4b525dde by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:31:07.704282 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Attempting to bind port 2f94307a-f496-4b83-80a6-634c4b525dde on network 185aeb08-41ef-4fae-a420-33296f710850 {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:07.716450 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 30, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:31:07.717341 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Checking segment: {'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:07.718020 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:07.718622 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Bound using segment: {'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:31:07.719355 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Bound port: 2f94307a-f496-4b83-80a6-634c4b525dde, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:31:07.719943 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:07.734044 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:07.817053 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.db_base_plugin_common [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Allocated IP 172.20.0.2 (fd37a1fc-3614-462b-92a2-b41260c949a2/62551f0b-3202-4a06-842d-a67bd8fa187b/8295641e-b70d-4e0a-b8a8-b3d819b2a7de) {{(pid=102319) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:31:07.859264 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] For port 2f94307a-f496-4b83-80a6-634c4b525dde, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:31:07.865116 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] For port 2f94307a-f496-4b83-80a6-634c4b525dde, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=2f94307a-f496-4b83-80a6-634c4b525dde,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:31:07.965191 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:07.992173 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Allocated IP 172.27.2.166 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/b7ef0c25-a20a-4d35-9d9c-c024cd837ede) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:31:08.124311 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48784) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:08.170702 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-de9a5ad2-9101-4e3a-bd01-7136a0d55122 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:08.207148 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-98ebd9e9-e6a2-4e66-8115-cebcdcc7946c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:08.318033 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe511834-21aa-40f5-8feb-4ea84db85ef2 None None] Pushing event updated for resources: {'Port': ['ID=2f94307a-f496-4b83-80a6-634c4b525dde,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:08.419214 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Publish callbacks [] for port, precommit_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:08.427129 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:08.454835 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:08.495583 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-de9a5ad2-9101-4e3a-bd01-7136a0d55122 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:08.536078 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-de9a5ad2-9101-4e3a-bd01-7136a0d55122 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:08.553789 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Network fd37a1fc-3614-462b-92a2-b41260c949a2 is already hosted by enough agents. {{(pid=102319) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:08.564624 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.base_scheduler [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Resources bound (agent type, host, resource id): {{(pid=102319) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:08.598180 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Received port after_create {{(pid=102319) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:31:08.697785 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de9a5ad2-9101-4e3a-bd01-7136a0d55122 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9930ded4-c2ec-4872-98da-183671c7c345,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:08.697785 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48808) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:08.697785 dv-cinder-819778-3-iscsi neutron-server[102318]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 08 11:31:08.699219 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:08.791384 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Pushing event updated for resources: {'Port': ['ID=8295641e-b70d-4e0a-b8a8-b3d819b2a7de,revision_number=1']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:08.800835 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Attempting to bind port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:31:08.801621 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Attempting to bind port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:31:08.802850 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Attempting to bind port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de on network fd37a1fc-3614-462b-92a2-b41260c949a2 {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:08.819201 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 30, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:31:08.821000 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Checking segment: {'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:08.821692 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:08.824460 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Bound using segment: {'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:31:08.827990 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Bound port: 8295641e-b70d-4e0a-b8a8-b3d819b2a7de, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:31:08.828731 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:08.922285 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-de9a5ad2-9101-4e3a-bd01-7136a0d55122 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=bc4118baa6554a599ddec3e0a40f4a7f&name=default HTTP/1.1" status: 200 len: 2992 time: 1.2597072 Dec 08 11:31:08.926519 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 48812) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:08.926936 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 48814) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:08.949471 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:08.966162 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:08.971408 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Pushing event updated for resources: {'Port': ['ID=b7ef0c25-a20a-4d35-9d9c-c024cd837ede,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:08.988329 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] For port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:31:08.990926 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:31:08.996796 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-98ebd9e9-e6a2-4e66-8115-cebcdcc7946c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.013503 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] For port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=8295641e-b70d-4e0a-b8a8-b3d819b2a7de,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:31:09.020997 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.022181 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-98ebd9e9-e6a2-4e66-8115-cebcdcc7946c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.091424 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-98ebd9e9-e6a2-4e66-8115-cebcdcc7946c admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=f9e2474afbfd4c0199cc70015a225879&name=default HTTP/1.1" status: 200 len: 2992 time: 0.9611297 Dec 08 11:31:09.096705 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98ebd9e9-e6a2-4e66-8115-cebcdcc7946c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec185909-9cf5-4763-9844-4158092d30f9,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:09.099024 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48832) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:09.099545 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48834) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:09.138132 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e6e3e02-c1d4-42f9-997b-09a641df6111 None None] Pushing event updated for resources: {'Port': ['ID=8295641e-b70d-4e0a-b8a8-b3d819b2a7de,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:09.163480 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.220475 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ec3c56-529e-4da1-a631-19864916930b req-7a55db48-4267-4516-8499-8b5cffa0aea3 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:09.225859 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-7a55db48-4267-4516-8499-8b5cffa0aea3 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/networks?id=d0180d44-2173-43bc-b3b2-67db13c39ea0 HTTP/1.1" status: 200 len: 812 time: 0.5701575 Dec 08 11:31:09.242998 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1a864dfa-4f20-4bf1-8cf7-5486a166fc47 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.256775 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.268878 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cec5fde0-91e6-46b9-a2f0-4e936b988653 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.292825 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-c113e173-e294-4c9e-b3df-f32fe0e7b89a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/quotas/1770e8f8a0b34c0aa4adafccc2df6628 HTTP/1.1" status: 200 len: 375 time: 0.0418069 Dec 08 11:31:09.389961 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cec5fde0-91e6-46b9-a2f0-4e936b988653 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.403401 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3d515960-c74f-4744-9156-a4e5da2287d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.410517 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-b274407f-7d09-4097-91ff-6b004d252415 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=1770e8f8a0b34c0aa4adafccc2df6628&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1078491 Dec 08 11:31:09.468504 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed0da05-3861-4002-8423-20429aa2518f req-79ed5f2f-3abe-4266-80ca-4dc34af70e7d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:09.475625 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-79ed5f2f-3abe-4266-80ca-4dc34af70e7d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/networks?id=6e4bda07-1ae1-4be4-bf28-e94211f51919 HTTP/1.1" status: 200 len: 813 time: 0.3635337 Dec 08 11:31:09.518561 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3d515960-c74f-4744-9156-a4e5da2287d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.539956 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-88605cae-2784-45ab-9f9a-baa4f80a1df8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/quotas/34e91fcdeaf64d10965b2770cbeab690 HTTP/1.1" status: 200 len: 375 time: 0.0600369 Dec 08 11:31:09.559258 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.610431 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1a864dfa-4f20-4bf1-8cf7-5486a166fc47 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.615735 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-c7724cc3-5e90-48d0-a14f-b25d7856cb4f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0706687 Dec 08 11:31:09.619989 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1a864dfa-4f20-4bf1-8cf7-5486a166fc47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.645415 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Allocated IP 172.27.2.186 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/fb627125-0851-47a7-84b3-bf51972e7b44) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:31:09.658349 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-43408628-f2a3-4a37-9479-f7c60e089a7f service neutron] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102318) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:31:09.659351 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-43408628-f2a3-4a37-9479-f7c60e089a7f service neutron] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1112857 Dec 08 11:31:09.663597 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cec5fde0-91e6-46b9-a2f0-4e936b988653 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.668004 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cec5fde0-91e6-46b9-a2f0-4e936b988653 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.671604 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-cec5fde0-91e6-46b9-a2f0-4e936b988653 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/9930ded4-c2ec-4872-98da-183671c7c345 HTTP/1.1" status: 204 len: 168 time: 0.7374318 Dec 08 11:31:09.715523 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-1a864dfa-4f20-4bf1-8cf7-5486a166fc47 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=fe3370ba4a10406c88b28b7dc1ae6129&name=default HTTP/1.1" status: 200 len: 2992 time: 0.7872956 Dec 08 11:31:09.743470 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a864dfa-4f20-4bf1-8cf7-5486a166fc47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d9e7195-fbb6-4e83-9e5b-9d61ccf593dd,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:09.745797 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 48852) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:09.786116 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3d515960-c74f-4744-9156-a4e5da2287d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.788959 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3d515960-c74f-4744-9156-a4e5da2287d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.790915 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-3d515960-c74f-4744-9156-a4e5da2287d3 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/ec185909-9cf5-4763-9844-4158092d30f9 HTTP/1.1" status: 204 len: 168 time: 0.6803167 Dec 08 11:31:09.817787 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d515960-c74f-4744-9156-a4e5da2287d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec185909-9cf5-4763-9844-4158092d30f9,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:09.838625 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cec5fde0-91e6-46b9-a2f0-4e936b988653 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9930ded4-c2ec-4872-98da-183671c7c345,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:09.903252 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:09.943744 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-f8283f67-b674-4c59-a5a6-7bfeb623450e service neutron] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102318) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:31:09.952406 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-f8283f67-b674-4c59-a5a6-7bfeb623450e service neutron] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2504866 Dec 08 11:31:09.964178 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-ed13856d-e243-42b8-8aa1-7a1e616e9101 service neutron] 10.222.0.66 "GET /v2.0/networks/d0180d44-2173-43bc-b3b2-67db13c39ea0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2931831 Dec 08 11:31:09.994345 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2afcf4c-50e5-4994-8339-ff714fcd46a9 None None] Network 185aeb08-41ef-4fae-a420-33296f710850 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:31:10.035881 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7895264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7889773'] for router, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:10.049783 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-62451195-d68a-46a2-b15a-840bf1e931c2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:10.083756 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-62451195-d68a-46a2-b15a-840bf1e931c2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:10.113087 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:10.126543 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-f21cbd76-8861-45cd-adfa-6ac3e7d5b72f None None] Provisioning complete for port 2f94307a-f496-4b83-80a6-634c4b525dde triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:10.127751 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-f21cbd76-8861-45cd-adfa-6ac3e7d5b72f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:10.249503 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:10.260521 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:10.271120 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-f21cbd76-8861-45cd-adfa-6ac3e7d5b72f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:10.292248 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48862) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:10.294467 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:31:10.324392 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-f21cbd76-8861-45cd-adfa-6ac3e7d5b72f None None] For port 2f94307a-f496-4b83-80a6-634c4b525dde, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=2f94307a-f496-4b83-80a6-634c4b525dde,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:10.342642 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-f21cbd76-8861-45cd-adfa-6ac3e7d5b72f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:10.401425 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-62451195-d68a-46a2-b15a-840bf1e931c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:10.407206 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-62451195-d68a-46a2-b15a-840bf1e931c2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:10.407884 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f21cbd76-8861-45cd-adfa-6ac3e7d5b72f None None] Pushing event updated for resources: {'Port': ['ID=2f94307a-f496-4b83-80a6-634c4b525dde,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:10.408247 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-62451195-d68a-46a2-b15a-840bf1e931c2 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/5d9e7195-fbb6-4e83-9e5b-9d61ccf593dd HTTP/1.1" status: 204 len: 168 time: 0.6598601 Dec 08 11:31:10.412037 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 8295641e-b70d-4e0a-b8a8-b3d819b2a7de up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:10.423602 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Pushing event updated for resources: {'Port': ['ID=fb627125-0851-47a7-84b3-bf51972e7b44,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:10.455160 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-c38dc674-12da-49de-8ae2-82c810266822 service neutron] 10.222.0.66 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5016544 Dec 08 11:31:10.472296 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-22e36a0f-c533-44af-98be-e02f7f87e28e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:10.479414 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62451195-d68a-46a2-b15a-840bf1e931c2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d9e7195-fbb6-4e83-9e5b-9d61ccf593dd,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:10.593307 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:10.594417 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:10.664186 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-7b78ffac-0bcb-4697-887a-133cbb86d6d3 service neutron] 10.222.0.66 "GET /v2.0/networks/d0180d44-2173-43bc-b3b2-67db13c39ea0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6453528 Dec 08 11:31:10.690010 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-3a6e6165-0a1b-458b-a429-d28a8a1d496e service neutron] 10.222.0.66 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2205884 Dec 08 11:31:10.713216 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Router e1280faa-8f3b-40a4-8270-5461288df246 is scheduled to L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f with binding_index 1 {{(pid=102317) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 08 11:31:10.783429 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85f2eddf-9f5e-4939-9b52-f4bd22b28eb1 None None] Network fd37a1fc-3614-462b-92a2-b41260c949a2 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:31:10.863222 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:10.965352 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:31:10.983014 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Sync routers for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:31:10.985856 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-2b266696-9547-4480-90aa-9ba8725199b6 None None] Provisioning complete for port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:10.986243 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2b266696-9547-4480-90aa-9ba8725199b6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:11.002031 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=8295641e-b70d-4e0a-b8a8-b3d819b2a7de,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:11.009262 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:31:11.012367 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:30:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:11.029433 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] Publish callbacks [] for router, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:11.030930 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-2a93a7d7-70ad-4dd4-9c56-7dfcbff98f58 admin admin] 10.222.0.66 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 4.4408758 Dec 08 11:31:11.034453 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 48876) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:11.034847 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:11.035640 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 2f94307a-f496-4b83-80a6-634c4b525dde up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:11.272054 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 48892) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:11.307048 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-3610e4df-fbd6-445c-b431-88fb6db807df admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:11.470301 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=8295641e-b70d-4e0a-b8a8-b3d819b2a7de,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:11.553930 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 2f94307a-f496-4b83-80a6-634c4b525dde triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:11.554303 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:11.558389 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0e76c521-332f-4849-8026-b5bbba016170 req-61ea040e-2b37-4941-aa29-10e090964d37 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 210 time: 0.1254947 Dec 08 11:31:11.601064 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-3610e4df-fbd6-445c-b431-88fb6db807df admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:11.630931 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:31:11.646917 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-27863717-ee08-495f-9f83-45353706c452 req-fc2a755c-ec7d-4343-9216-70abd302bff5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 210 time: 0.0858819 Dec 08 11:31:11.688170 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-22e36a0f-c533-44af-98be-e02f7f87e28e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:11.699821 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:11.703742 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-22e36a0f-c533-44af-98be-e02f7f87e28e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:11.725684 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-3610e4df-fbd6-445c-b431-88fb6db807df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:11.785755 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-22e36a0f-c533-44af-98be-e02f7f87e28e admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=22a035f327f049128c34ab4afb5e55a5&name=default HTTP/1.1" status: 200 len: 2992 time: 1.4695878 Dec 08 11:31:11.788751 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e36a0f-c533-44af-98be-e02f7f87e28e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e261eeb-b4c1-4224-b4ef-a1b0e121303b,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:11.793647 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48928) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:11.894962 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-3610e4df-fbd6-445c-b431-88fb6db807df admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=915c6f76853b4be4b212fc5c761fa7f1&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6167107 Dec 08 11:31:11.902504 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 48934) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:11.942212 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-7b313628-5948-481c-902c-0bd30ee4791e None None] Provisioning complete for port 2f94307a-f496-4b83-80a6-634c4b525dde triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:11.943601 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-7b313628-5948-481c-902c-0bd30ee4791e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.010411 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c3095ce6-cd8a-471f-8b5c-2f0a3640ef2e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.031896 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3610e4df-fbd6-445c-b431-88fb6db807df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e631c56c-c86e-4938-b12e-f3a765e7dd2b,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:12.092485 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c3095ce6-cd8a-471f-8b5c-2f0a3640ef2e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.140657 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fa7ed1a5-3256-4e7c-98bd-67bee76a6db4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.175790 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fa7ed1a5-3256-4e7c-98bd-67bee76a6db4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.194160 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:09Z', 'revision_number': 3, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:12.219834 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-7b313628-5948-481c-902c-0bd30ee4791e None None] Provisioning complete for port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:12.220354 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-7b313628-5948-481c-902c-0bd30ee4791e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.289059 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 8295641e-b70d-4e0a-b8a8-b3d819b2a7de up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:12.299484 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Checking router: e1280faa-8f3b-40a4-8270-5461288df246 for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:31:12.300848 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Updating router e1280faa-8f3b-40a4-8270-5461288df246 port b7ef0c25-a20a-4d35-9d9c-c024cd837ede binding host dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:31:12.386440 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.401086 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:12.401685 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.508416 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c3095ce6-cd8a-471f-8b5c-2f0a3640ef2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.511066 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c3095ce6-cd8a-471f-8b5c-2f0a3640ef2e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.512220 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-c3095ce6-cd8a-471f-8b5c-2f0a3640ef2e admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/e631c56c-c86e-4938-b12e-f3a765e7dd2b HTTP/1.1" status: 204 len: 168 time: 0.6087620 Dec 08 11:31:12.531397 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3095ce6-cd8a-471f-8b5c-2f0a3640ef2e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e631c56c-c86e-4938-b12e-f3a765e7dd2b,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:12.550246 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7895264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7889773'] for router, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.554861 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fa7ed1a5-3256-4e7c-98bd-67bee76a6db4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.568902 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fa7ed1a5-3256-4e7c-98bd-67bee76a6db4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.571558 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-fa7ed1a5-3256-4e7c-98bd-67bee76a6db4 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/1e261eeb-b4c1-4224-b4ef-a1b0e121303b HTTP/1.1" status: 204 len: 168 time: 0.7755311 Dec 08 11:31:12.587739 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 2f94307a-f496-4b83-80a6-634c4b525dde up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:12.635265 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.722429 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 2f94307a-f496-4b83-80a6-634c4b525dde triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:12.722872 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.731620 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa7ed1a5-3256-4e7c-98bd-67bee76a6db4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e261eeb-b4c1-4224-b4ef-a1b0e121303b,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:12.892816 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9f7ff9c5-cd3c-4ee2-8fad-fc405d59659c req-c1d25f52-add9-4f8b-8551-9ca8e64ebe0e tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 210 time: 0.1330235 Dec 08 11:31:12.910644 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6cb7f63b-6dc1-4c16-9f5c-ec5ee6229af0 req-9e429a03-ed9d-498c-9f62-147cb4fad578 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 210 time: 0.1635106 Dec 08 11:31:12.942717 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Publish callbacks [] for port, precommit_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:12.953803 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:13.027442 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Attempting to bind port b7ef0c25-a20a-4d35-9d9c-c024cd837ede on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:31:13.029780 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Attempting to bind port b7ef0c25-a20a-4d35-9d9c-c024cd837ede by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:31:13.030793 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Attempting to bind port b7ef0c25-a20a-4d35-9d9c-c024cd837ede on network d7cb3021-649a-44ca-b3a1-005b3941164e {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:13.035114 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Pushing event updated for resources: {'Port': ['ID=b7ef0c25-a20a-4d35-9d9c-c024cd837ede,revision_number=2']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:13.041931 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 30, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:31:13.042648 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Checking segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102320) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:13.043240 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:13.043814 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Bound using segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:31:13.044568 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Bound port: b7ef0c25-a20a-4d35-9d9c-c024cd837ede, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:31:13.045186 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:13.077444 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:13.077819 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:13.078179 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:13.078524 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:13.083105 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:13.083105 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:13.083105 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:13.083105 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:13.083105 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:13.083105 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:13.083105 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:13.083105 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:13.083105 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Tracked resource versions report: Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: pushed versions: Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: { 'AddressGroup': {'1.2'}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'ConntrackHelper': {'1.0'}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'LocalIPAssociation': {'1.0'}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Log': {'1.0'}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Network': {'1.1'}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Port': {'1.7'}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'PortForwarding': {'1.2'}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'QosPolicy': {'1.10'}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'SecurityGroup': {'1.5'}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'SecurityGroupRule': {'1.2'}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'SubPort': {'1.0'}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Subnet': {'1.1'}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Trunk': {'1.1'}} Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: consumer versions: Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: { DHCP agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: HyperV agent@hv-cinder-81977: {}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: L3 agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: Metadata agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: Metering agent@dv-cinder-819778-3-iscsi: {}, Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: Open vSwitch agent@dv-cinder-819778-3-iscsi: { 'AddressGroup': '1.2', Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'ConntrackHelper': '1.0', Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'LocalIPAssociation': '1.0', Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Log': '1.0', Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Network': '1.1', Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Port': '1.7', Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'PortForwarding': '1.2', Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'QosPolicy': '1.10', Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'SecurityGroup': '1.5', Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'SecurityGroupRule': '1.2', Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'SubPort': '1.0', Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Subnet': '1.1', Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: 'Trunk': '1.1'}} Dec 08 11:31:13.084027 dv-cinder-819778-3-iscsi neutron-server[102320]: {{(pid=102320) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 08 11:31:13.115466 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Allocated IP 172.20.0.1 (185aeb08-41ef-4fae-a420-33296f710850/40a584f7-ce77-4d89-87c2-4f3f589c6700/3344a7ff-723b-43bf-afa4-716acfe3b78f) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:31:13.146584 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f is scheduled to L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f with binding_index 1 {{(pid=102318) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 08 11:31:13.154965 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] For port b7ef0c25-a20a-4d35-9d9c-c024cd837ede, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102320) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:31:13.161229 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] For port b7ef0c25-a20a-4d35-9d9c-c024cd837ede, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=b7ef0c25-a20a-4d35-9d9c-c024cd837ede,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102320) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:31:13.169097 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:13.264508 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30a7e5f9-6817-499c-bcd2-f24576d953a3 None None] Pushing event updated for resources: {'Port': ['ID=b7ef0c25-a20a-4d35-9d9c-c024cd837ede,revision_number=3']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:13.267539 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:31:13.268047 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:30:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:13.369050 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:13.420909 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:31:13.422944 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:13.427791 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:31:13.440884 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Sync routers for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:31:13.456186 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] Publish callbacks [] for router, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:13.457495 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-bb6fc2be-d2c9-4277-909a-3f7830f2e933 admin admin] 10.222.0.66 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 6.5228026 Dec 08 11:31:13.460278 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 49010) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:13.478901 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:31:13.480798 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:30:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:13.525138 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Network 185aeb08-41ef-4fae-a420-33296f710850 is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:13.535151 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:13.539860 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:31:13.541690 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7898680'] for router_interface, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:13.787730 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:31:13.996033 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:09Z', 'revision_number': 3, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:14.033720 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce8ddf0f-c5d6-44ff-a939-3a906b577bc1 None None] The sync data for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi is: [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:09Z', 'revision_number': 3, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:31:14.084938 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Pushing event updated for resources: {'Port': ['ID=3344a7ff-723b-43bf-afa4-716acfe3b78f,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:14.178936 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49036) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:14.252273 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:14.391389 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-0b0b85ab-75a2-4e79-9bb7-653a896705b0 None None] Provisioning complete for port 3344a7ff-723b-43bf-afa4-716acfe3b78f triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:14.391764 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0b0b85ab-75a2-4e79-9bb7-653a896705b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:14.476400 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-aae4276b-1812-40a9-b8bd-947c92ee7084 req-8fbb1441-523c-4bd2-8bd2-4d5b968b8a2f tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 210 time: 0.1191437 Dec 08 11:31:14.483995 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-0b0b85ab-75a2-4e79-9bb7-653a896705b0 None None] Port 3344a7ff-723b-43bf-afa4-716acfe3b78f cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:31:14.497512 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f91a711a-6039-4432-b962-62ad9a42e666 req-78683e36-f243-4d03-aafb-57ef6ccefbb9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 210 time: 0.1416869 Dec 08 11:31:14.575057 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:10Z', 'revision_number': 3, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:14.624425 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:14.675874 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Checking router: d1e1bffc-ba94-4ef3-b10a-203d4ed7519f for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:31:14.681465 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Updating router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f port fb627125-0851-47a7-84b3-bf51972e7b44 binding host dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:31:14.749283 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:14.761616 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.61', 56747) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:14.855976 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4c297695-f8fb-4b2c-a6e7-db7fe9243bd8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:15.184257 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4c297695-f8fb-4b2c-a6e7-db7fe9243bd8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:15.192380 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:15.201287 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4c297695-f8fb-4b2c-a6e7-db7fe9243bd8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:15.272372 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-4c297695-f8fb-4b2c-a6e7-db7fe9243bd8 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=e22a7b1715bf42c3854bcc6e214872fc&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0879066 Dec 08 11:31:15.272372 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:15.274562 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8074899', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7897000'] for router_interface, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:15.291485 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49070) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:15.419682 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Pushing event updated for resources: {'Port': ['ID=3344a7ff-723b-43bf-afa4-716acfe3b78f,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:15.433944 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Publish callbacks [] for port, precommit_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:15.448419 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:15.479696 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Allocated IP 172.20.0.1 (fd37a1fc-3614-462b-92a2-b41260c949a2/62551f0b-3202-4a06-842d-a67bd8fa187b/3ed90e59-4866-4e65-989d-ebfaacbd446e) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:31:15.597063 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed0da05-3861-4002-8423-20429aa2518f req-039c8026-de7d-494a-8d95-78469da0c385 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:15.598890 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-039c8026-de7d-494a-8d95-78469da0c385 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "GET /v2.0/networks?id=6e4bda07-1ae1-4be4-bf28-e94211f51919 HTTP/1.1" status: 200 len: 813 time: 0.8356950 Dec 08 11:31:15.607228 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Attempting to bind port fb627125-0851-47a7-84b3-bf51972e7b44 on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:31:15.607841 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Attempting to bind port fb627125-0851-47a7-84b3-bf51972e7b44 by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:31:15.607989 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Attempting to bind port fb627125-0851-47a7-84b3-bf51972e7b44 on network d7cb3021-649a-44ca-b3a1-005b3941164e {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:15.631488 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 30, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:31:15.632211 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Checking segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:15.632306 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:15.633240 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Bound using segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:31:15.637641 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Bound port: fb627125-0851-47a7-84b3-bf51972e7b44, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:31:15.640093 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:15.696619 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-4ed0da05-3861-4002-8423-20429aa2518f req-323d96ea-1d92-447e-b359-3163c2339eab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Request body: {'port': {'device_id': 'c7fa09fb-ae2b-4479-8848-f142131fe33a', 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919', 'admin_state_up': True, 'tenant_id': '34e91fcdeaf64d10965b2770cbeab690'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:15.724356 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c297695-f8fb-4b2c-a6e7-db7fe9243bd8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ae4c356-9b7e-4abe-b3e6-f4523a6bba23,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:15.770986 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Network 185aeb08-41ef-4fae-a420-33296f710850 is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:15.774899 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-d8856da2-558d-4894-8ebd-6ea9d90761c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:15.783407 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:15.799020 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] For port fb627125-0851-47a7-84b3-bf51972e7b44, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:31:15.815139 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] For port fb627125-0851-47a7-84b3-bf51972e7b44, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=fb627125-0851-47a7-84b3-bf51972e7b44,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:31:15.828315 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:15.830445 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4599cdbe-f6d5-4299-aa02-ac9ab0ba2222 None None] Pushing event updated for resources: {'Port': ['ID=fb627125-0851-47a7-84b3-bf51972e7b44,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:15.892117 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.61', 56755) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:15.961492 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4599cdbe-f6d5-4299-aa02-ac9ab0ba2222 None None] Pushing event updated for resources: {'Port': ['ID=fb627125-0851-47a7-84b3-bf51972e7b44,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:16.013231 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-d8856da2-558d-4894-8ebd-6ea9d90761c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:16.016071 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:31:16.016699 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:30:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:16.018676 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Router e1280faa-8f3b-40a4-8270-5461288df246 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:31:16.293952 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device b7ef0c25-a20a-4d35-9d9c-c024cd837ede up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:16.305599 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ec3c56-529e-4da1-a631-19864916930b req-f80b381a-1d69-4b41-94a2-2d5de12216fc tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:16.307350 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-f80b381a-1d69-4b41-94a2-2d5de12216fc tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.61 "GET /v2.0/networks?id=d0180d44-2173-43bc-b3b2-67db13c39ea0 HTTP/1.1" status: 200 len: 812 time: 0.3870053 Dec 08 11:31:16.317841 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-d8856da2-558d-4894-8ebd-6ea9d90761c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:16.320540 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-d8856da2-558d-4894-8ebd-6ea9d90761c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:16.320913 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d461c02d-4b89-4d5d-87ec-1ac23212f41f req-e4165a5a-9f44-46dc-97c1-317c27d882ef tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 210 time: 0.5700943 Dec 08 11:31:16.321961 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-d8856da2-558d-4894-8ebd-6ea9d90761c1 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/1ae4c356-9b7e-4abe-b3e6-f4523a6bba23 HTTP/1.1" status: 204 len: 168 time: 0.9153702 Dec 08 11:31:16.334110 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8856da2-558d-4894-8ebd-6ea9d90761c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ae4c356-9b7e-4abe-b3e6-f4523a6bba23,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:16.369710 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-de045da0-f719-4d36-9155-abc8692a1aaf req-cf40baf4-bd35-4fbd-9f00-952d6ad20614 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 210 time: 0.4753802 Dec 08 11:31:16.376854 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:31:16.382454 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-d8ec3c56-529e-4da1-a631-19864916930b req-c9bdc5d7-ec80-48c2-a423-0f7d078ffebe tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Request body: {'port': {'device_id': 'fe445662-9a2d-4c17-96ea-b054be927e53', 'network_id': 'd0180d44-2173-43bc-b3b2-67db13c39ea0', 'admin_state_up': True, 'tenant_id': '1770e8f8a0b34c0aa4adafccc2df6628'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:16.382618 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-49b8f8ab-90c5-4a1f-8da2-f2b854ed8f48 admin admin] 10.222.0.66 "PUT /v2.0/routers/e1280faa-8f3b-40a4-8270-5461288df246/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.3466809 Dec 08 11:31:16.416100 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:31:16.484385 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port b7ef0c25-a20a-4d35-9d9c-c024cd837ede triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:16.485100 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:16.509832 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-2f4ffe5d-713a-48ce-b860-4873fe36d73a None None] Provisioning complete for port 3344a7ff-723b-43bf-afa4-716acfe3b78f triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:16.510311 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2f4ffe5d-713a-48ce-b860-4873fe36d73a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:16.513532 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:16.669012 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4ed0da05-3861-4002-8423-20429aa2518f req-323d96ea-1d92-447e-b359-3163c2339eab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Made reservation on behalf of 34e91fcdeaf64d10965b2770cbeab690 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:16.670299 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-2f4ffe5d-713a-48ce-b860-4873fe36d73a None None] Port 3344a7ff-723b-43bf-afa4-716acfe3b78f cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:31:16.671940 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ed0da05-3861-4002-8423-20429aa2518f req-323d96ea-1d92-447e-b359-3163c2339eab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:16.753775 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:16.760704 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:10Z', 'revision_number': 3, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:16.795754 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8175385-45e6-49ac-aaf0-1d28a7375cd8 None None] The sync data for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi is: [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:10Z', 'revision_number': 3, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:31:16.811965 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port b7ef0c25-a20a-4d35-9d9c-c024cd837ede, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=b7ef0c25-a20a-4d35-9d9c-c024cd837ede,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:16.822224 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:16.870436 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d8ec3c56-529e-4da1-a631-19864916930b req-c9bdc5d7-ec80-48c2-a423-0f7d078ffebe tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Made reservation on behalf of 1770e8f8a0b34c0aa4adafccc2df6628 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:16.881410 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec3c56-529e-4da1-a631-19864916930b req-c9bdc5d7-ec80-48c2-a423-0f7d078ffebe tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:16.887096 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:16.907670 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=b7ef0c25-a20a-4d35-9d9c-c024cd837ede,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:16.919606 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Sync routers for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:31:16.935738 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:31:16.936791 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:30:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:16.965524 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Pushing event updated for resources: {'Port': ['ID=3ed90e59-4866-4e65-989d-ebfaacbd446e,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:17.014276 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Network fd37a1fc-3614-462b-92a2-b41260c949a2 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:17.043933 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:17.061234 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:31:17.061234 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7898680'] for router_interface, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:17.170838 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:31:17.545014 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:17.624791 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-8e68e9df-0c6f-43d7-9ac0-940e352ca300 None None] Provisioning complete for port 3ed90e59-4866-4e65-989d-ebfaacbd446e triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:17.625751 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-8e68e9df-0c6f-43d7-9ac0-940e352ca300 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:17.743142 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-8e68e9df-0c6f-43d7-9ac0-940e352ca300 None None] Port 3ed90e59-4866-4e65-989d-ebfaacbd446e cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:31:17.776261 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 2, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:17.787476 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:17.809440 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-4ed0da05-3861-4002-8423-20429aa2518f req-323d96ea-1d92-447e-b359-3163c2339eab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Allocated IP 172.20.0.13 (6e4bda07-1ae1-4be4-bf28-e94211f51919/d6b1fb0e-d38f-47ca-a647-53b824c47e76/d9ecab87-157e-4ccb-8423-2248bb8451ea) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:31:17.859955 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Checking router: e1280faa-8f3b-40a4-8270-5461288df246 for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:31:17.860258 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Updating router e1280faa-8f3b-40a4-8270-5461288df246 port 3344a7ff-723b-43bf-afa4-716acfe3b78f binding host dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:31:17.944924 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:18.058170 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49170) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:18.065255 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-2e777783-61f3-460b-834e-35876c041ffb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Request body: {'security_group': {'name': 'tempest-securitygroup--179580436', 'description': 'tempest-description--1729145464'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:18.176927 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2e777783-61f3-460b-834e-35876c041ffb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:18.447820 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device b7ef0c25-a20a-4d35-9d9c-c024cd837ede up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:18.469426 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-757f326a-5791-4e7b-af23-a5166055de64 req-0b27cda5-9664-4547-8373-fa6c0e6a127c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 210 time: 0.8453238 Dec 08 11:31:18.471074 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2e777783-61f3-460b-834e-35876c041ffb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:18.492577 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2e777783-61f3-460b-834e-35876c041ffb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:18.635226 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Publish callbacks [] for port, precommit_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:18.645962 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:18.689636 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-d8ec3c56-529e-4da1-a631-19864916930b req-c9bdc5d7-ec80-48c2-a423-0f7d078ffebe tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Allocated IP 172.20.0.5 (d0180d44-2173-43bc-b3b2-67db13c39ea0/2d9f9ed3-4577-43a0-80bf-cc86dab7d362/8e4b1127-3db2-4f93-a731-315192c060b3) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:31:18.697132 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2e777783-61f3-460b-834e-35876c041ffb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:18.707097 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-2e777783-61f3-460b-834e-35876c041ffb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.6459608 Dec 08 11:31:18.713446 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49178) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:18.728181 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port b7ef0c25-a20a-4d35-9d9c-c024cd837ede triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:18.730782 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:18.731856 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-858e1f63-f14c-4865-86f1-3c3e728b9ce1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Request body: {'security_group_rule': {'security_group_id': 'ec46dd19-fbbc-4297-9312-9548f39f5aef', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:18.750478 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-453bf3e3-b814-4a0b-98c2-f26c92713ae7 None None] Pushing event updated for resources: {'Port': ['ID=3344a7ff-723b-43bf-afa4-716acfe3b78f,revision_number=3']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:18.793755 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e777783-61f3-460b-834e-35876c041ffb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event updated for resources: {'SecurityGroup': ['ID=ec46dd19-fbbc-4297-9312-9548f39f5aef,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:18.917926 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Attempting to bind port 3344a7ff-723b-43bf-afa4-716acfe3b78f on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:31:18.918306 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Attempting to bind port 3344a7ff-723b-43bf-afa4-716acfe3b78f by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:31:18.918674 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Attempting to bind port 3344a7ff-723b-43bf-afa4-716acfe3b78f on network 185aeb08-41ef-4fae-a420-33296f710850 {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:18.936703 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 30, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:31:18.938356 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Checking segment: {'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102320) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:18.940664 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:18.941369 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Bound using segment: {'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:31:18.942135 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Bound port: 3344a7ff-723b-43bf-afa4-716acfe3b78f, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'}}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:31:18.944322 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:18.958872 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-858e1f63-f14c-4865-86f1-3c3e728b9ce1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.101387 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec3c56-529e-4da1-a631-19864916930b req-c9bdc5d7-ec80-48c2-a423-0f7d078ffebe tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.170791 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] For port 3344a7ff-723b-43bf-afa4-716acfe3b78f, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102320) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:31:19.177453 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device fb627125-0851-47a7-84b3-bf51972e7b44 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:19.183251 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] For port 3344a7ff-723b-43bf-afa4-716acfe3b78f, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=3344a7ff-723b-43bf-afa4-716acfe3b78f,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102320) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:31:19.193003 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.259546 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-858e1f63-f14c-4865-86f1-3c3e728b9ce1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.267854 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-858e1f63-f14c-4865-86f1-3c3e728b9ce1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.295653 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec3c56-529e-4da1-a631-19864916930b req-c9bdc5d7-ec80-48c2-a423-0f7d078ffebe tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.325489 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-30b366fa-deb0-4b40-b599-0ee647ef22b2 req-4a71bae5-4c46-49d8-af89-2699b130712f tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 210 time: 0.9232714 Dec 08 11:31:19.326344 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:31:19.327231 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-858e1f63-f14c-4865-86f1-3c3e728b9ce1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c96bb43-06fa-4d80-a017-91fcc93effc4,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:19.328026 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:30:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:19.362763 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port fb627125-0851-47a7-84b3-bf51972e7b44 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:19.363213 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-858e1f63-f14c-4865-86f1-3c3e728b9ce1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.363583 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.370673 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-858e1f63-f14c-4865-86f1-3c3e728b9ce1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6535716 Dec 08 11:31:19.372843 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49202) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:19.388144 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-421e4f92-4835-4ac7-b4c1-666fd7ecfb0c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Request body: {'security_group_rule': {'security_group_id': 'ec46dd19-fbbc-4297-9312-9548f39f5aef', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:19.454722 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-421e4f92-4835-4ac7-b4c1-666fd7ecfb0c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.504729 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-453bf3e3-b814-4a0b-98c2-f26c92713ae7 None None] Pushing event updated for resources: {'Port': ['ID=3344a7ff-723b-43bf-afa4-716acfe3b78f,revision_number=4']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:19.534920 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-a02420a5-5238-406c-9990-d58673635b5b None None] Provisioning complete for port 3344a7ff-723b-43bf-afa4-716acfe3b78f triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:19.539853 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a02420a5-5238-406c-9990-d58673635b5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.676548 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-421e4f92-4835-4ac7-b4c1-666fd7ecfb0c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.683887 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-421e4f92-4835-4ac7-b4c1-666fd7ecfb0c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.704099 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:31:19.735822 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-421e4f92-4835-4ac7-b4c1-666fd7ecfb0c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fa7d3c69-0897-4701-be7a-e6a0653d173e,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:19.768390 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-421e4f92-4835-4ac7-b4c1-666fd7ecfb0c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.777307 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-421e4f92-4835-4ac7-b4c1-666fd7ecfb0c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3990216 Dec 08 11:31:19.782236 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49208) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:19.807934 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Request body: {'floatingip': {'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:19.843190 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:19.920635 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:20.030881 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port fb627125-0851-47a7-84b3-bf51972e7b44, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=fb627125-0851-47a7-84b3-bf51972e7b44,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:20.042361 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:20.068274 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a02420a5-5238-406c-9990-d58673635b5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:20.199845 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9bdc5d7-ec80-48c2-a423-0f7d078ffebe tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Pushing event updated for resources: {'Port': ['ID=8e4b1127-3db2-4f93-a731-315192c060b3,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:20.238173 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-a02420a5-5238-406c-9990-d58673635b5b None None] For port 3344a7ff-723b-43bf-afa4-716acfe3b78f, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=3344a7ff-723b-43bf-afa4-716acfe3b78f,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:20.250298 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a02420a5-5238-406c-9990-d58673635b5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:20.254612 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=fb627125-0851-47a7-84b3-bf51972e7b44,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:20.313636 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2078d534-1568-4193-b73b-3b200a0126a0 req-c9a3aff5-faf6-4680-acea-83d46f3503c0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 210 time: 0.1147931 Dec 08 11:31:20.328819 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d8ec3c56-529e-4da1-a631-19864916930b req-c9bdc5d7-ec80-48c2-a423-0f7d078ffebe tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Network d0180d44-2173-43bc-b3b2-67db13c39ea0 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:20.340578 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-d8ec3c56-529e-4da1-a631-19864916930b req-c9bdc5d7-ec80-48c2-a423-0f7d078ffebe tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:20.353208 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-d8ec3c56-529e-4da1-a631-19864916930b req-c9bdc5d7-ec80-48c2-a423-0f7d078ffebe tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:31:20.353208 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ec3c56-529e-4da1-a631-19864916930b req-c9bdc5d7-ec80-48c2-a423-0f7d078ffebe tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:20.355240 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec3c56-529e-4da1-a631-19864916930b req-c9bdc5d7-ec80-48c2-a423-0f7d078ffebe tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:20.386518 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a02420a5-5238-406c-9990-d58673635b5b None None] Pushing event updated for resources: {'Port': ['ID=3344a7ff-723b-43bf-afa4-716acfe3b78f,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:20.418670 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-1dcbd8ec-b60a-4809-ab01-a6983dfe0113 None None] Provisioning complete for port 3344a7ff-723b-43bf-afa4-716acfe3b78f triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:20.419057 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1dcbd8ec-b60a-4809-ab01-a6983dfe0113 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:20.509362 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:20.600688 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:20.603827 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a64d4f0-37c6-4fd2-8489-ba066b41ede8 None None] The sync data for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi is: [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:31:20.735055 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-c9bdc5d7-ec80-48c2-a423-0f7d078ffebe tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 4.3826191 Dec 08 11:31:20.806176 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-cc60bf72-6f35-4fb5-ab16-7c55abaa36aa tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102318) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:31:20.819494 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-cc60bf72-6f35-4fb5-ab16-7c55abaa36aa tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0236094 Dec 08 11:31:20.846351 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ed0da05-3861-4002-8423-20429aa2518f req-323d96ea-1d92-447e-b359-3163c2339eab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:21.050452 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Allocated IP 172.27.2.124 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/d46e8300-fa4a-42b8-955d-4026377ba7a0) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:31:21.079968 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4818407-a3f6-49f3-99dd-c8108fbab4bb req-7624c1e4-1bfc-4c40-a37d-537bef5bbaac tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:21.088296 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4818407-a3f6-49f3-99dd-c8108fbab4bb req-7624c1e4-1bfc-4c40-a37d-537bef5bbaac tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 931 time: 0.5348043 Dec 08 11:31:21.278608 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ed0da05-3861-4002-8423-20429aa2518f req-323d96ea-1d92-447e-b359-3163c2339eab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:21.448899 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4ed0da05-3861-4002-8423-20429aa2518f req-323d96ea-1d92-447e-b359-3163c2339eab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Network 6e4bda07-1ae1-4be4-bf28-e94211f51919 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:21.484924 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-4ed0da05-3861-4002-8423-20429aa2518f req-323d96ea-1d92-447e-b359-3163c2339eab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:21.488123 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ed0da05-3861-4002-8423-20429aa2518f req-323d96ea-1d92-447e-b359-3163c2339eab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:31:21.489360 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:21.496544 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed0da05-3861-4002-8423-20429aa2518f req-323d96ea-1d92-447e-b359-3163c2339eab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:21.497641 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ed0da05-3861-4002-8423-20429aa2518f req-323d96ea-1d92-447e-b359-3163c2339eab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:21.549944 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4818407-a3f6-49f3-99dd-c8108fbab4bb req-89ad25ba-204d-4f5b-929f-d2aed9740726 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4471085 Dec 08 11:31:21.554331 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-323d96ea-1d92-447e-b359-3163c2339eab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 5.8815007 Dec 08 11:31:21.567115 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:21.594975 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-323d96ea-1d92-447e-b359-3163c2339eab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Pushing event updated for resources: {'Port': ['ID=d9ecab87-157e-4ccb-8423-2248bb8451ea,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:21.598939 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:21.600723 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8074899', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7897000'] for router_interface, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:21.686134 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:21.786270 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Pushing event updated for resources: {'Port': ['ID=3ed90e59-4866-4e65-989d-ebfaacbd446e,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:21.826266 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecb4e3c9-08f0-4447-8b9d-872d756e9a9e req-b2c3c9fc-0b4a-4d19-9261-9f233a1e69f5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:21.831903 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ecb4e3c9-08f0-4447-8b9d-872d756e9a9e req-b2c3c9fc-0b4a-4d19-9261-9f233a1e69f5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 932 time: 0.2664542 Dec 08 11:31:21.894473 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:21.965740 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:21.968988 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event updated for resources: {'Port': ['ID=d46e8300-fa4a-42b8-955d-4026377ba7a0,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:21.978368 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:31:21.993768 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Request body: {'port': {'device_id': 'fe445662-9a2d-4c17-96ea-b054be927e53', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:22.183714 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:22.207903 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Request body: {'port': {'device_id': 'c7fa09fb-ae2b-4479-8848-f142131fe33a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:22.285402 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:22.310993 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ecb4e3c9-08f0-4447-8b9d-872d756e9a9e req-069471e5-23ac-4eb4-b7ba-862a4aaa2223 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4460783 Dec 08 11:31:22.369779 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Network fd37a1fc-3614-462b-92a2-b41260c949a2 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:22.386376 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:22.402591 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device fb627125-0851-47a7-84b3-bf51972e7b44 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:22.530357 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-68dc440c-21ff-4597-bf3b-5aeee7c5becb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:22.551003 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port fb627125-0851-47a7-84b3-bf51972e7b44 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:22.551718 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:22.553521 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:22.570054 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:22.733840 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:22.743215 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:22.818586 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:22.847861 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event updated for resources: {'Port': ['ID=d46e8300-fa4a-42b8-955d-4026377ba7a0,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:22.863480 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:22.874070 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-c635a2b0-1294-479b-bfa7-9125b2cec04f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.0821197 Dec 08 11:31:22.884284 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 3344a7ff-723b-43bf-afa4-716acfe3b78f up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:23.017298 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-974a79ac-ca7b-4c65-9ee4-6d3db7f109be None None] Provisioning complete for port 3ed90e59-4866-4e65-989d-ebfaacbd446e triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:23.017609 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-974a79ac-ca7b-4c65-9ee4-6d3db7f109be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:23.336719 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 3344a7ff-723b-43bf-afa4-716acfe3b78f triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:23.337185 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:23.337654 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:31:23.350139 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-974a79ac-ca7b-4c65-9ee4-6d3db7f109be None None] Port 3ed90e59-4866-4e65-989d-ebfaacbd446e cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:31:23.410624 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b8218bf-90da-4f47-9f73-846c152305e8 req-c707ddba-8b9b-459e-98ba-ddaf330af9df tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:23.415956 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b8218bf-90da-4f47-9f73-846c152305e8 req-c707ddba-8b9b-459e-98ba-ddaf330af9df tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 931 time: 0.6515150 Dec 08 11:31:23.503089 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d9ecab87-157e-4ccb-8423-2248bb8451ea {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:31:23.517048 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:23.539280 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Transition to ACTIVE for port object d9ecab87-157e-4ccb-8423-2248bb8451ea will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:31:23.551723 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:23.764321 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Pushing event updated for resources: {'Port': ['ID=d9ecab87-157e-4ccb-8423-2248bb8451ea,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:23.906039 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b8218bf-90da-4f47-9f73-846c152305e8 req-f3e8c558-1fcc-4d19-8a23-06be947507ac tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3572755 Dec 08 11:31:23.933541 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-366702c6-ebbd-4590-9b4f-1a1297deea0f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?name=tempest-securitygroup--179580436&fields=id&tenant_id=9c60094b48d34489b46e92ae73d7e33a HTTP/1.1" status: 200 len: 267 time: 0.6093261 Dec 08 11:31:24.469005 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8e4b1127-3db2-4f93-a731-315192c060b3 {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:31:24.478520 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:24.500056 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Transition to ACTIVE for port object 8e4b1127-3db2-4f93-a731-315192c060b3 will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:31:24.581671 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Attempting to bind port d9ecab87-157e-4ccb-8423-2248bb8451ea on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:31:24.582004 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Attempting to bind port d9ecab87-157e-4ccb-8423-2248bb8451ea by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:31:24.582355 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Attempting to bind port d9ecab87-157e-4ccb-8423-2248bb8451ea on network 6e4bda07-1ae1-4be4-bf28-e94211f51919 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:24.584803 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:31:24.590884 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:24.597449 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Sync routers for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:31:24.616974 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:31:24.623722 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:30:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:24.626976 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-4d059546-3c0b-48ad-a118-2062f0515391 admin admin] 10.222.0.66 "PUT /v2.0/routers/d1e1bffc-ba94-4ef3-b10a-203d4ed7519f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.1650512 Dec 08 11:31:24.751151 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Port d9ecab87-157e-4ccb-8423-2248bb8451ea on network 6e4bda07-1ae1-4be4-bf28-e94211f51919 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:31:24.751515 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Attempting to bind port d9ecab87-157e-4ccb-8423-2248bb8451ea on network 6e4bda07-1ae1-4be4-bf28-e94211f51919 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:24.791005 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 31, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:31:24.791375 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Checking segment: {'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:24.791971 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Bound using segment: {'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:31:24.792440 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Bound port: d9ecab87-157e-4ccb-8423-2248bb8451ea, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:31:24.792786 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:24.806584 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d7c64486-4e3d-4030-acaa-a7d1ab95e6d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:24.903353 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Pushing event updated for resources: {'Port': ['ID=8e4b1127-3db2-4f93-a731-315192c060b3,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:24.934264 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd45b749-b876-48af-938f-662cac649b5e req-f324200e-5970-46a0-82f1-8b03994abb80 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:24.936370 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fd45b749-b876-48af-938f-662cac649b5e req-f324200e-5970-46a0-82f1-8b03994abb80 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 944 time: 0.8576722 Dec 08 11:31:24.982713 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:31:25.012862 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Attempting to bind port 8e4b1127-3db2-4f93-a731-315192c060b3 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:31:25.013514 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Attempting to bind port 8e4b1127-3db2-4f93-a731-315192c060b3 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': '5be28b76-0677-4ab9-a950-5242cff71605', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': 'd0180d44-2173-43bc-b3b2-67db13c39ea0'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:31:25.014010 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Attempting to bind port 8e4b1127-3db2-4f93-a731-315192c060b3 on network d0180d44-2173-43bc-b3b2-67db13c39ea0 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:25.042080 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Port 8e4b1127-3db2-4f93-a731-315192c060b3 on network d0180d44-2173-43bc-b3b2-67db13c39ea0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:31:25.042663 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Attempting to bind port 8e4b1127-3db2-4f93-a731-315192c060b3 on network d0180d44-2173-43bc-b3b2-67db13c39ea0 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:25.061111 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-70a114ee-58f5-4d62-807e-a8247235e103 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:25.062987 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-70a114ee-58f5-4d62-807e-a8247235e103 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/networks?id=185aeb08-41ef-4fae-a420-33296f710850 HTTP/1.1" status: 200 len: 810 time: 1.1038885 Dec 08 11:31:25.134726 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 31, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:31:25.135447 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Checking segment: {'id': '5be28b76-0677-4ab9-a950-5242cff71605', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': 'd0180d44-2173-43bc-b3b2-67db13c39ea0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:25.136062 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Bound using segment: {'id': '5be28b76-0677-4ab9-a950-5242cff71605', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': 'd0180d44-2173-43bc-b3b2-67db13c39ea0'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:31:25.138754 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Bound port: 8e4b1127-3db2-4f93-a731-315192c060b3, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5be28b76-0677-4ab9-a950-5242cff71605', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 295, 'network_id': 'd0180d44-2173-43bc-b3b2-67db13c39ea0'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:31:25.139380 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:25.172666 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-e64ac070-6df9-4a46-96a9-fcfd327869c7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/quotas/9c60094b48d34489b46e92ae73d7e33a HTTP/1.1" status: 200 len: 375 time: 0.0756142 Dec 08 11:31:25.180300 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] For port d9ecab87-157e-4ccb-8423-2248bb8451ea, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:31:25.196994 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fd45b749-b876-48af-938f-662cac649b5e req-1c252ae1-e48e-4391-9989-05bcaf1472c2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2133439 Dec 08 11:31:25.346995 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] For port d9ecab87-157e-4ccb-8423-2248bb8451ea, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d9ecab87-157e-4ccb-8423-2248bb8451ea,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:31:25.369969 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:25.449998 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:25.451847 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:25.454140 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] 10.222.0.61 "PUT /v2.0/ports/d9ecab87-157e-4ccb-8423-2248bb8451ea HTTP/1.1" status: 200 len: 1094 time: 3.5982134 Dec 08 11:31:25.497610 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c7fa09fb-ae2b-4479-8848-f142131fe33a', 'tag': 'd9ecab87-157e-4ccb-8423-2248bb8451ea'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:31:25.579284 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:20Z', 'revision_number': 2, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:25.635297 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Checking router: d1e1bffc-ba94-4ef3-b10a-203d4ed7519f for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:31:25.636440 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Updating router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f port 3ed90e59-4866-4e65-989d-ebfaacbd446e binding host dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:31:25.715469 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:25.768287 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-727b0feb-f5df-4501-99e0-ec467d6910b6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=9c60094b48d34489b46e92ae73d7e33a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.5484009 Dec 08 11:31:25.784070 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-203b3eef-99b9-4979-bd6a-6b18c834a9b8" -d '{"events": [{"name": "network-changed", "server_uuid": "c7fa09fb-ae2b-4479-8848-f142131fe33a", "tag": "d9ecab87-157e-4ccb-8423-2248bb8451ea"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:31:25.786869 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:25.793665 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] For port 8e4b1127-3db2-4f93-a731-315192c060b3, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:31:25.797496 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] For port 8e4b1127-3db2-4f93-a731-315192c060b3, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=8e4b1127-3db2-4f93-a731-315192c060b3,segment=NetworkSegment(5be28b76-0677-4ab9-a950-5242cff71605),segment_id=5be28b76-0677-4ab9-a950-5242cff71605)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:31:25.811210 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:25.836967 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eec08e18-f540-4cf5-a2f6-2276f1b419aa service neutron] Pushing event updated for resources: {'Port': ['ID=d9ecab87-157e-4ccb-8423-2248bb8451ea,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:25.976211 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Pushing event updated for resources: {'Port': ['ID=8e4b1127-3db2-4f93-a731-315192c060b3,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:25.986920 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:25.987892 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:25.989357 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-740ee462-cb0c-47e9-b671-8c956e127da8 service neutron] 10.222.0.61 "PUT /v2.0/ports/8e4b1127-3db2-4f93-a731-315192c060b3 HTTP/1.1" status: 200 len: 1093 time: 4.7435989 Dec 08 11:31:26.129048 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-9f58cd9b-5bbd-4453-9bfe-765fd68fb7d7 service neutron] 10.222.0.66 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2801266 Dec 08 11:31:26.264810 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Publish callbacks [] for port, precommit_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:26.287189 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:26.289277 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-3ad485bc-2d0c-45a1-9fed-cfdf4986a93f service neutron] 10.222.0.66 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1515286 Dec 08 11:31:26.480732 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b84d81b5-bd77-44bc-b1b0-df6c467af860 None None] Pushing event updated for resources: {'Port': ['ID=3ed90e59-4866-4e65-989d-ebfaacbd446e,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:26.525994 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 49390) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:26.532653 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-31ac1e17-b220-4946-8d1f-84e2abc9296c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1884414149', 'description': 'tempest-description--1202217190'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:26.655475 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ac1e17-b220-4946-8d1f-84e2abc9296c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:26.693692 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Attempting to bind port 3ed90e59-4866-4e65-989d-ebfaacbd446e on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:31:26.708570 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Attempting to bind port 3ed90e59-4866-4e65-989d-ebfaacbd446e by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:31:26.709398 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Attempting to bind port 3ed90e59-4866-4e65-989d-ebfaacbd446e on network fd37a1fc-3614-462b-92a2-b41260c949a2 {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:26.728902 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 30, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:31:26.730042 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Checking segment: {'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:26.731316 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:26.736171 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Bound using segment: {'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:31:26.737013 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Bound port: 3ed90e59-4866-4e65-989d-ebfaacbd446e, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:31:26.737705 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:26.795341 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49400) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:26.887670 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] For port 3ed90e59-4866-4e65-989d-ebfaacbd446e, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:31:26.894424 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] For port 3ed90e59-4866-4e65-989d-ebfaacbd446e, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=3ed90e59-4866-4e65-989d-ebfaacbd446e,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:31:26.922272 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:27.014267 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14443596-860c-4ced-bc2b-60393c38273c req-cc8838d6-b33d-4a7b-bd0e-9c81ed6f883a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:27.029088 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-14443596-860c-4ced-bc2b-60393c38273c req-cc8838d6-b33d-4a7b-bd0e-9c81ed6f883a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 943 time: 0.3599286 Dec 08 11:31:27.150430 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-116ffbbb-6a32-4007-80bf-426a0ccdbf02 None None] Provisioning complete for port 3ed90e59-4866-4e65-989d-ebfaacbd446e triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:27.153690 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-116ffbbb-6a32-4007-80bf-426a0ccdbf02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:27.219837 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f00c0fea-07c1-4fe5-8cbb-ddda8e5c3b04 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:27.249993 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:31:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-17f97a31-3ae1-459e-94be-1e9dfc6b2be2 x-openstack-request-id: req-17f97a31-3ae1-459e-94be-1e9dfc6b2be2 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:31:27.250690 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c7fa09fb-ae2b-4479-8848-f142131fe33a", "tag": "d9ecab87-157e-4ccb-8423-2248bb8451ea", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:31:27.251554 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-17f97a31-3ae1-459e-94be-1e9dfc6b2be2 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:31:27.252791 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c7fa09fb-ae2b-4479-8848-f142131fe33a', 'tag': 'd9ecab87-157e-4ccb-8423-2248bb8451ea', 'status': 'completed', 'code': 200} Dec 08 11:31:27.297803 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-14443596-860c-4ced-bc2b-60393c38273c req-cb75d08d-fc03-43d3-9178-67a97334245d tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2677042 Dec 08 11:31:27.305740 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ac1e17-b220-4946-8d1f-84e2abc9296c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:27.342159 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ac1e17-b220-4946-8d1f-84e2abc9296c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:27.347693 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:27.349136 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b84d81b5-bd77-44bc-b1b0-df6c467af860 None None] Pushing event updated for resources: {'Port': ['ID=3ed90e59-4866-4e65-989d-ebfaacbd446e,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:27.354541 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:31:27.355161 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:31:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:27.576808 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-116ffbbb-6a32-4007-80bf-426a0ccdbf02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:27.582581 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:31:27.754792 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-116ffbbb-6a32-4007-80bf-426a0ccdbf02 None None] For port 3ed90e59-4866-4e65-989d-ebfaacbd446e, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=3ed90e59-4866-4e65-989d-ebfaacbd446e,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:27.762975 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f00c0fea-07c1-4fe5-8cbb-ddda8e5c3b04 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:27.769302 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f00c0fea-07c1-4fe5-8cbb-ddda8e5c3b04 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:27.795125 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-116ffbbb-6a32-4007-80bf-426a0ccdbf02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:27.805750 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ac1e17-b220-4946-8d1f-84e2abc9296c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4bc81893-96c8-4fe5-ac25-8ff352618e25,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:27.860970 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-f00c0fea-07c1-4fe5-8cbb-ddda8e5c3b04 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=b9a11f5098ea470ab2e0db2fcdaad49c&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0621641 Dec 08 11:31:27.861613 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49436) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:27.890889 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ac1e17-b220-4946-8d1f-84e2abc9296c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:27.892672 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-116ffbbb-6a32-4007-80bf-426a0ccdbf02 None None] Pushing event updated for resources: {'Port': ['ID=3ed90e59-4866-4e65-989d-ebfaacbd446e,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:27.896811 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-31ac1e17-b220-4946-8d1f-84e2abc9296c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.3685968 Dec 08 11:31:27.929717 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 49438) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:27.930326 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 49440) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:27.936622 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f00c0fea-07c1-4fe5-8cbb-ddda8e5c3b04 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1eda9dde-00ea-4272-a7d5-26b42b02fe6e,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:27.964416 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-4b001e9d-db2c-401e-8691-23c3181f3222 None None] Provisioning complete for port 3ed90e59-4866-4e65-989d-ebfaacbd446e triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:27.964803 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-4b001e9d-db2c-401e-8691-23c3181f3222 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:28.025596 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-e5ad93a0-b384-4674-a61a-78319a1601bc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Request body: {'security_group_rule': {'security_group_id': '4bc81893-96c8-4fe5-ac25-8ff352618e25', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:28.031791 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:26Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:28.050784 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-051d652c-b921-47d7-9ee1-a851e56ccd27 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:28.062952 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7e0f562-7c87-4df2-b705-9848bf62f7b5 None None] The sync data for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi is: [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:26Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:31:28.103173 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-051d652c-b921-47d7-9ee1-a851e56ccd27 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:28.162413 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-590b53d0-cd08-4c8d-bd2c-65effe4396e2 req-a1fa364f-029d-44d5-8c7f-d8037f20d5b4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 210 time: 0.3728967 Dec 08 11:31:28.198498 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:28.283171 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e5ad93a0-b384-4674-a61a-78319a1601bc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:28.308021 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203b3eef-99b9-4979-bd6a-6b18c834a9b8 req-8f828b8b-9e64-46ab-be95-7d16b32d0bf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:28.311715 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-203b3eef-99b9-4979-bd6a-6b18c834a9b8 req-8f828b8b-9e64-46ab-be95-7d16b32d0bf0 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 1097 time: 0.9089324 Dec 08 11:31:28.315393 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-051d652c-b921-47d7-9ee1-a851e56ccd27 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:28.323570 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-051d652c-b921-47d7-9ee1-a851e56ccd27 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:28.328847 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-051d652c-b921-47d7-9ee1-a851e56ccd27 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/1eda9dde-00ea-4272-a7d5-26b42b02fe6e HTTP/1.1" status: 204 len: 168 time: 0.3908436 Dec 08 11:31:28.359266 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-051d652c-b921-47d7-9ee1-a851e56ccd27 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1eda9dde-00ea-4272-a7d5-26b42b02fe6e,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:28.470612 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ec3c56-529e-4da1-a631-19864916930b req-a7fa9618-8db0-4b1c-b06f-fe2147f37afb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:28.472207 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-a7fa9618-8db0-4b1c-b06f-fe2147f37afb service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=1770e8f8a0b34c0aa4adafccc2df6628&device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 1096 time: 1.0737805 Dec 08 11:31:28.547275 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a1b9c204-c445-4093-a1c7-bb14ac092137 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:28.636487 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18904506-dfbe-4e98-852a-263dd6a3f3e9 req-57f6dec0-19f0-406a-96f6-05b4fdd692ee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:28.639076 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-18904506-dfbe-4e98-852a-263dd6a3f3e9 req-57f6dec0-19f0-406a-96f6-05b4fdd692ee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 944 time: 1.2328637 Dec 08 11:31:28.960249 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49458) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:29.012902 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-259bdf81-91a7-4bfc-8b06-7a5d6683f30f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:29.217770 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203b3eef-99b9-4979-bd6a-6b18c834a9b8 req-9b37ac7e-bd1d-4956-8a5c-36698dbcc721 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:29.219523 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-203b3eef-99b9-4979-bd6a-6b18c834a9b8 req-9b37ac7e-bd1d-4956-8a5c-36698dbcc721 service neutron] 10.222.0.61 "GET /v2.0/networks?tenant_id=34e91fcdeaf64d10965b2770cbeab690&shared=False HTTP/1.1" status: 200 len: 914 time: 0.8130064 Dec 08 11:31:29.238542 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-9254ffce-0326-4ce0-ae46-bf1245ebf1b5 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8e4b1127-3db2-4f93-a731-315192c060b3 HTTP/1.1" status: 200 len: 217 time: 0.3266704 Dec 08 11:31:29.274273 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-259bdf81-91a7-4bfc-8b06-7a5d6683f30f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:29.281003 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-259bdf81-91a7-4bfc-8b06-7a5d6683f30f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:29.341699 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-259bdf81-91a7-4bfc-8b06-7a5d6683f30f admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=284150e6603d41fc8bdb3fc8877d6bcb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3792028 Dec 08 11:31:29.347195 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49474) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:29.361728 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a1b9c204-c445-4093-a1c7-bb14ac092137 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:29.385231 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e5ad93a0-b384-4674-a61a-78319a1601bc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:29.385231 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fe445662-9a2d-4c17-96ea-b054be927e53', 'tag': '8e4b1127-3db2-4f93-a731-315192c060b3'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:31:29.388195 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1abf5a94-8cca-4ae9-9924-9fd39613b350" -d '{"events": [{"name": "network-changed", "server_uuid": "fe445662-9a2d-4c17-96ea-b054be927e53", "tag": "8e4b1127-3db2-4f93-a731-315192c060b3"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:31:29.401373 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e5ad93a0-b384-4674-a61a-78319a1601bc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:29.413346 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a1b9c204-c445-4093-a1c7-bb14ac092137 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:29.446171 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-a1b9c204-c445-4093-a1c7-bb14ac092137 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=401dcb6cd72c4d2eafc20d78afe6dbf6&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4622343 Dec 08 11:31:29.454479 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3524e6ea-65c0-4c55-8e42-f15e0c38cc8a req-87368a9b-6a46-4324-af74-f6694da57506 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:29.456731 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3524e6ea-65c0-4c55-8e42-f15e0c38cc8a req-87368a9b-6a46-4324-af74-f6694da57506 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 943 time: 0.9538205 Dec 08 11:31:29.458601 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 49482) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:29.566027 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-259bdf81-91a7-4bfc-8b06-7a5d6683f30f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0f8492c-7735-499a-bde8-c63f1ee192b6,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:29.593383 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c05abf54-82ca-4d9f-b33f-395d30c1d236 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:29.593649 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-18904506-dfbe-4e98-852a-263dd6a3f3e9 req-fa9067d6-b41c-44e3-9087-bb4ce9a6c62c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8451626 Dec 08 11:31:29.677917 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c05abf54-82ca-4d9f-b33f-395d30c1d236 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:29.821637 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c05abf54-82ca-4d9f-b33f-395d30c1d236 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:29.825799 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c05abf54-82ca-4d9f-b33f-395d30c1d236 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:29.827613 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-c05abf54-82ca-4d9f-b33f-395d30c1d236 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/c0f8492c-7735-499a-bde8-c63f1ee192b6 HTTP/1.1" status: 204 len: 168 time: 0.4754107 Dec 08 11:31:29.841529 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c05abf54-82ca-4d9f-b33f-395d30c1d236 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0f8492c-7735-499a-bde8-c63f1ee192b6,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:30.316913 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 3ed90e59-4866-4e65-989d-ebfaacbd446e up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:30.401082 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 3ed90e59-4866-4e65-989d-ebfaacbd446e triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:30.402224 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:30.443260 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3524e6ea-65c0-4c55-8e42-f15e0c38cc8a req-e48b4199-1194-4f56-83e9-f5d99bce5c43 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9130168 Dec 08 11:31:30.444033 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5ad93a0-b384-4674-a61a-78319a1601bc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0f8b3e85-94b4-452f-b3fb-d0bf2b386e0a,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:30.446243 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1b9c204-c445-4093-a1c7-bb14ac092137 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=609f0614-f4bb-4b33-90f0-2ffc67c80394,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:30.522031 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e5ad93a0-b384-4674-a61a-78319a1601bc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:30.523722 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-e5ad93a0-b384-4674-a61a-78319a1601bc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 2.5386753 Dec 08 11:31:30.525455 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ec3c56-529e-4da1-a631-19864916930b req-6d56cb0f-e3c9-48b7-bc64-6f16ced18b42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:30.526834 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49516) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:30.527307 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-6d56cb0f-e3c9-48b7-bc64-6f16ced18b42 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2d9f9ed3-4577-43a0-80bf-cc86dab7d362 HTTP/1.1" status: 200 len: 852 time: 0.1031432 Dec 08 11:31:30.533917 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-b0081a33-60bf-433f-b8a8-0eaaab7ac84d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Request body: {'security_group_rule': {'security_group_id': '4bc81893-96c8-4fe5-ac25-8ff352618e25', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:30.565430 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-01784795-3450-4a3a-a11a-224aaf8e1786 req-683e4eb5-c926-4a51-94fd-67842c375202 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 210 time: 0.1422486 Dec 08 11:31:30.601871 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b0081a33-60bf-433f-b8a8-0eaaab7ac84d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:30.617134 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cc91c284-d616-4abb-8ef0-20fad5b8b0cd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:30.642597 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cc91c284-d616-4abb-8ef0-20fad5b8b0cd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:30.689465 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b0081a33-60bf-433f-b8a8-0eaaab7ac84d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:30.694807 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b0081a33-60bf-433f-b8a8-0eaaab7ac84d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:30.713019 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0081a33-60bf-433f-b8a8-0eaaab7ac84d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=999d845c-6228-4c7f-93f1-7e120283987c,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:30.718427 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:31:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-91df3301-3b3c-42b3-b285-49d220297a4c x-openstack-request-id: req-91df3301-3b3c-42b3-b285-49d220297a4c {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:31:30.718936 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fe445662-9a2d-4c17-96ea-b054be927e53", "tag": "8e4b1127-3db2-4f93-a731-315192c060b3", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:31:30.719385 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-91df3301-3b3c-42b3-b285-49d220297a4c {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:31:30.719915 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fe445662-9a2d-4c17-96ea-b054be927e53', 'tag': '8e4b1127-3db2-4f93-a731-315192c060b3', 'status': 'completed', 'code': 200} Dec 08 11:31:30.722235 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b0081a33-60bf-433f-b8a8-0eaaab7ac84d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:30.723705 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-b0081a33-60bf-433f-b8a8-0eaaab7ac84d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1945875 Dec 08 11:31:30.729796 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49526) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:30.737540 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Request body: {'floatingip': {'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:30.763476 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:30.790528 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cc91c284-d616-4abb-8ef0-20fad5b8b0cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:30.792992 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cc91c284-d616-4abb-8ef0-20fad5b8b0cd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:30.796420 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-cc91c284-d616-4abb-8ef0-20fad5b8b0cd admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/609f0614-f4bb-4b33-90f0-2ffc67c80394 HTTP/1.1" status: 204 len: 168 time: 1.3280146 Dec 08 11:31:30.835924 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc91c284-d616-4abb-8ef0-20fad5b8b0cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=609f0614-f4bb-4b33-90f0-2ffc67c80394,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:30.846640 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-203b3eef-99b9-4979-bd6a-6b18c834a9b8 req-ccd641de-c167-4ffe-b12a-f3e845efc205 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:30.848933 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-203b3eef-99b9-4979-bd6a-6b18c834a9b8 req-ccd641de-c167-4ffe-b12a-f3e845efc205 service neutron] 10.222.0.61 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 1.2896950 Dec 08 11:31:30.857477 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6df5e3b1-1d2f-48cd-9ae5-1f550e4c7a73 req-c4246e6f-3f64-45ee-b212-8dde8ad38d91 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:30.858983 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6df5e3b1-1d2f-48cd-9ae5-1f550e4c7a73 req-c4246e6f-3f64-45ee-b212-8dde8ad38d91 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 944 time: 0.1426272 Dec 08 11:31:30.932211 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:30.944792 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6df5e3b1-1d2f-48cd-9ae5-1f550e4c7a73 req-5cd58091-1bbe-4873-957f-3c53c392e5af tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0767632 Dec 08 11:31:31.079437 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Allocated IP 172.27.2.95 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/94e4067d-f16a-47b3-9d16-44b3d772c1b4) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:31:31.256084 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.269341 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 49556) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:31.289358 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6d03f98c-30b8-4ed7-99b3-106e8cb60fc6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.315884 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.357622 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:31.364424 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:31.368188 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:31:31.379180 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event updated for resources: {'Port': ['ID=94e4067d-f16a-47b3-9d16-44b3d772c1b4,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:31.418015 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6d03f98c-30b8-4ed7-99b3-106e8cb60fc6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.423372 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6d03f98c-30b8-4ed7-99b3-106e8cb60fc6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.431831 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.473706 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-6d03f98c-30b8-4ed7-99b3-106e8cb60fc6 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=01be4a95e51f4c0c83e129d6bdebfd4a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2020962 Dec 08 11:31:31.474808 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d03f98c-30b8-4ed7-99b3-106e8cb60fc6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb2a109d-252a-468d-bcb8-9ced9fadd0d2,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:31.476605 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49564) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:31.485024 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.577729 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bfe40bbe-7898-45a6-ac36-2cdeec8b5fe9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.595977 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-796054b2-9b37-4ee1-a894-2e1bf3a46591 req-ff7b5205-05a9-4e05-811f-b781d4334f71 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:31.597099 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-796054b2-9b37-4ee1-a894-2e1bf3a46591 req-ff7b5205-05a9-4e05-811f-b781d4334f71 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 943 time: 0.0563505 Dec 08 11:31:31.608784 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bfe40bbe-7898-45a6-ac36-2cdeec8b5fe9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.660859 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-796054b2-9b37-4ee1-a894-2e1bf3a46591 req-879caf6e-cfed-4b1d-a47d-bc598f734334 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576506 Dec 08 11:31:31.700797 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-31aab7a0-3075-41df-89ff-d584b0e33bd8 req-7a216a3d-086d-48e9-8c2b-15bf5631b294 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 210 time: 0.0329423 Dec 08 11:31:31.751106 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bfe40bbe-7898-45a6-ac36-2cdeec8b5fe9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.753935 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bfe40bbe-7898-45a6-ac36-2cdeec8b5fe9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.757585 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-bfe40bbe-7898-45a6-ac36-2cdeec8b5fe9 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/cb2a109d-252a-468d-bcb8-9ced9fadd0d2 HTTP/1.1" status: 204 len: 168 time: 0.2770524 Dec 08 11:31:31.764251 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 49580) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:31.771956 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfe40bbe-7898-45a6-ac36-2cdeec8b5fe9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb2a109d-252a-468d-bcb8-9ced9fadd0d2,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:31.785300 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.791263 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.822665 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.846480 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event updated for resources: {'Port': ['ID=94e4067d-f16a-47b3-9d16-44b3d772c1b4,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:31.851424 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:31.852727 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-c252ad8a-2f83-4939-8341-21b072f3342f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.1215513 Dec 08 11:31:32.046181 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-fd03083f-6db1-4b3f-aa16-00b68894a6e4 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=d0180d44-2173-43bc-b3b2-67db13c39ea0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0767717 Dec 08 11:31:32.112651 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7cbdd65c-1a35-4986-b0bc-5a5917992f1e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:32.206892 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f578bf90-9760-41ff-b2e3-b528c3a5bbb6 req-02dfc243-cbe0-4f0b-bd30-b320c68f643c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:32.208447 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f578bf90-9760-41ff-b2e3-b528c3a5bbb6 req-02dfc243-cbe0-4f0b-bd30-b320c68f643c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 944 time: 0.1747773 Dec 08 11:31:32.266539 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed0da05-3861-4002-8423-20429aa2518f req-69a98f6e-4101-4dc4-b201-74a3ab54dc40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:32.268099 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-69a98f6e-4101-4dc4-b201-74a3ab54dc40 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 1097 time: 0.2501700 Dec 08 11:31:32.371638 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-baaf690f-feb3-41ef-8eb9-20b807d8041a service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d9ecab87-157e-4ccb-8423-2248bb8451ea HTTP/1.1" status: 200 len: 217 time: 0.0841072 Dec 08 11:31:32.395903 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.61', 56777) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:32.400676 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-9416e119-6ed9-4ec1-98ff-f1cb0224d0bd service neutron] 10.222.0.61 "GET /v2.0/networks/d0180d44-2173-43bc-b3b2-67db13c39ea0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3252580 Dec 08 11:31:32.408481 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-45c6e7ed-eac2-47dc-8c81-ec3662aa06ba tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?name=tempest-securitygroup--1884414149&fields=id&tenant_id=44406e332fd94f1a9dcd704577410a61 HTTP/1.1" status: 200 len: 267 time: 0.2387011 Dec 08 11:31:32.441960 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f578bf90-9760-41ff-b2e3-b528c3a5bbb6 req-be95bb45-722a-4925-b033-18eeae4cfb80 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2206104 Dec 08 11:31:32.551914 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7cbdd65c-1a35-4986-b0bc-5a5917992f1e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:32.568992 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed0da05-3861-4002-8423-20429aa2518f req-e341c69f-c3d7-4b16-8f0f-7ea25139c32f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:32.570753 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-e341c69f-c3d7-4b16-8f0f-7ea25139c32f service neutron] 10.222.0.61 "GET /v2.0/subnets?id=d6b1fb0e-d38f-47ca-a647-53b824c47e76 HTTP/1.1" status: 200 len: 853 time: 0.1888692 Dec 08 11:31:32.626002 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7cbdd65c-1a35-4986-b0bc-5a5917992f1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:32.704630 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-0f6b91f5-b8d0-4535-8225-99fa46698635 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:32.706212 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-0f6b91f5-b8d0-4535-8225-99fa46698635 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.61 "GET /v2.0/networks?id=185aeb08-41ef-4fae-a420-33296f710850 HTTP/1.1" status: 200 len: 810 time: 0.3091018 Dec 08 11:31:32.728322 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-5146385e-95ef-4190-9832-40ba9e33e999 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=6e4bda07-1ae1-4be4-bf28-e94211f51919&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0548637 Dec 08 11:31:32.830207 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-7caa49a2-a4af-426b-a822-9ba260b334a3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9c60094b48d34489b46e92ae73d7e33a HTTP/1.1" status: 200 len: 379 time: 0.1128561 Dec 08 11:31:32.848232 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-d05e4902-59a5-42ff-9dd5-836a74a56ef0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Request body: {'port': {'device_id': '6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'admin_state_up': True, 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'security_groups': ['ec46dd19-fbbc-4297-9312-9548f39f5aef']}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:32.890164 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-7cbdd65c-1a35-4986-b0bc-5a5917992f1e admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=613da9902e7b45ff871dddf4205bc423&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1248133 Dec 08 11:31:32.891031 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cbdd65c-1a35-4986-b0bc-5a5917992f1e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0761b381-dce6-4415-a882-f1e8a9ae75a5,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:32.893409 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 49656) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:32.989979 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e64bd3b-e8cd-4a4b-b667-cff0d2d9c4d2 req-bc33979b-7e79-44b0-805d-419001fdcc76 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:32.991519 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9e64bd3b-e8cd-4a4b-b667-cff0d2d9c4d2 req-bc33979b-7e79-44b0-805d-419001fdcc76 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 943 time: 0.1817031 Dec 08 11:31:33.051439 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-d05e4902-59a5-42ff-9dd5-836a74a56ef0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Made reservation on behalf of 9c60094b48d34489b46e92ae73d7e33a for: {'port': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:33.055630 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-d05e4902-59a5-42ff-9dd5-836a74a56ef0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:33.066130 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2a05ea19-55e9-44bb-bf13-7f0c7f710a39 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:33.086707 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a27ac445-ab73-47ec-9a13-04653c7652f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:33.096729 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a27ac445-ab73-47ec-9a13-04653c7652f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 816 time: 0.6514857 Dec 08 11:31:33.110736 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec3c56-529e-4da1-a631-19864916930b req-70ea773e-0d7c-4271-97f5-380edf21dbb6 service neutron] 10.222.0.61 "GET /v2.0/networks/d0180d44-2173-43bc-b3b2-67db13c39ea0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6641908 Dec 08 11:31:33.210004 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-42ef247a-6804-4549-9759-75e9fe5ed639 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/quotas/44406e332fd94f1a9dcd704577410a61 HTTP/1.1" status: 200 len: 375 time: 0.1120765 Dec 08 11:31:33.246904 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2a05ea19-55e9-44bb-bf13-7f0c7f710a39 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:33.283937 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-90e3ae49-850f-4e9a-8161-971997b23de9 service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5396981 Dec 08 11:31:33.288587 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9e64bd3b-e8cd-4a4b-b667-cff0d2d9c4d2 req-f741d781-1ae0-4e6f-ad7a-68cd284dd244 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2627547 Dec 08 11:31:33.337502 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-d05e4902-59a5-42ff-9dd5-836a74a56ef0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Allocated IP 172.20.0.5 (185aeb08-41ef-4fae-a420-33296f710850/40a584f7-ce77-4d89-87c2-4f3f589c6700/731fa8a4-e27d-4561-a86e-aa21c87548e7) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:31:33.461476 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-798e9cdd-02ae-4e7d-8de4-16cfc42c7038 req-368f2e94-9ef7-4717-a8da-509c94afba22 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 210 time: 0.0565152 Dec 08 11:31:33.463161 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-6da4036c-5fa4-4177-910d-ef51bd006211 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:33.464604 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-6da4036c-5fa4-4177-910d-ef51bd006211 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=1770e8f8a0b34c0aa4adafccc2df6628&device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 1096 time: 0.2879114 Dec 08 11:31:33.475171 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-426ed0b7-ae80-403c-9ec0-bfa46d527ec0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2642004 Dec 08 11:31:33.497330 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ed0da05-3861-4002-8423-20429aa2518f req-92789597-9ebe-47b0-ac12-16ccd361585c service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2008698 Dec 08 11:31:33.569453 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-d05e4902-59a5-42ff-9dd5-836a74a56ef0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:33.600182 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2a05ea19-55e9-44bb-bf13-7f0c7f710a39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:33.604135 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2a05ea19-55e9-44bb-bf13-7f0c7f710a39 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:33.607781 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-d05e4902-59a5-42ff-9dd5-836a74a56ef0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:33.608020 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-2a05ea19-55e9-44bb-bf13-7f0c7f710a39 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/0761b381-dce6-4415-a882-f1e8a9ae75a5 HTTP/1.1" status: 204 len: 168 time: 0.6999500 Dec 08 11:31:33.864769 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d05e4902-59a5-42ff-9dd5-836a74a56ef0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event updated for resources: {'Port': ['ID=731fa8a4-e27d-4561-a86e-aa21c87548e7,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:33.876372 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-d05e4902-59a5-42ff-9dd5-836a74a56ef0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Network 185aeb08-41ef-4fae-a420-33296f710850 is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:33.877906 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-d05e4902-59a5-42ff-9dd5-836a74a56ef0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:33.880209 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-d05e4902-59a5-42ff-9dd5-836a74a56ef0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:31:33.885950 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-d05e4902-59a5-42ff-9dd5-836a74a56ef0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:33.886573 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-d05e4902-59a5-42ff-9dd5-836a74a56ef0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:33.910048 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-d05e4902-59a5-42ff-9dd5-836a74a56ef0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0674558 Dec 08 11:31:33.930816 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Request body: {'port': {'device_id': '6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:33.940564 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a05ea19-55e9-44bb-bf13-7f0c7f710a39 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0761b381-dce6-4415-a882-f1e8a9ae75a5,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:33.956029 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-98200393-486b-4bf7-a868-97601120f44a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:33.956029 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-98200393-486b-4bf7-a868-97601120f44a service neutron] 10.222.0.61 "GET /v2.0/networks?id=d0180d44-2173-43bc-b3b2-67db13c39ea0 HTTP/1.1" status: 200 len: 913 time: 0.4732218 Dec 08 11:31:33.997098 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 49688) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:34.010952 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:34.039417 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-ae4bc669-15fb-4e77-be9c-db1938f890a6 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=8e4b1127-3db2-4f93-a731-315192c060b3 HTTP/1.1" status: 200 len: 217 time: 0.0715475 Dec 08 11:31:34.057101 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-690a494d-4fa0-45d6-b463-4ee0be012ba8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:34.152176 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03cc7a62-eda3-4993-9482-81419f5d1b76 req-fe997efa-7018-4bb1-9ddd-994ed016a5a5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:34.153878 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-03cc7a62-eda3-4993-9482-81419f5d1b76 req-fe997efa-7018-4bb1-9ddd-994ed016a5a5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 944 time: 0.5548551 Dec 08 11:31:34.189872 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-9a4fbe46-a630-4143-bb30-d1076e397208 service neutron] 10.222.0.66 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6700873 Dec 08 11:31:34.231164 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-98f4ea5f-63d2-4cd4-8299-4aafc89d1f41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:34.233314 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-98f4ea5f-63d2-4cd4-8299-4aafc89d1f41 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=2d9f9ed3-4577-43a0-80bf-cc86dab7d362 HTTP/1.1" status: 200 len: 852 time: 0.1790154 Dec 08 11:31:34.242460 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-709a9f6b-ce78-4d72-aa47-eb33c1450cb6 None None] Provisioning complete for port 731fa8a4-e27d-4561-a86e-aa21c87548e7 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:34.243093 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-709a9f6b-ce78-4d72-aa47-eb33c1450cb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:34.321625 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-5c4d1305-e802-446d-9061-5f7b40a8d0b0 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=d0180d44-2173-43bc-b3b2-67db13c39ea0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0528665 Dec 08 11:31:34.340718 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-709a9f6b-ce78-4d72-aa47-eb33c1450cb6 None None] Port 731fa8a4-e27d-4561-a86e-aa21c87548e7 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:31:34.401849 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-03cc7a62-eda3-4993-9482-81419f5d1b76 req-209d36a0-f0de-4ab0-8a24-12a44973b933 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2283118 Dec 08 11:31:34.457231 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.notifiers.nova [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 731fa8a4-e27d-4561-a86e-aa21c87548e7 {{(pid=102317) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:31:34.472788 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-64509856-5116-41e7-b208-d45e292d8cc2 service neutron] 10.222.0.66 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2706952 Dec 08 11:31:34.475013 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:34.502804 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-553d761c-6bb3-4df3-b07b-66ee4a44bde9 service neutron] 10.222.0.61 "GET /v2.0/networks/d0180d44-2173-43bc-b3b2-67db13c39ea0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1625926 Dec 08 11:31:34.520418 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-690a494d-4fa0-45d6-b463-4ee0be012ba8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:34.532100 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.provisioning_blocks [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Transition to ACTIVE for port object 731fa8a4-e27d-4561-a86e-aa21c87548e7 will not be triggered until provisioned by entity L2. {{(pid=102317) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:31:34.538565 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:34.614662 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-690a494d-4fa0-45d6-b463-4ee0be012ba8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:34.755958 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.managers [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Attempting to bind port 731fa8a4-e27d-4561-a86e-aa21c87548e7 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:31:34.756418 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.managers [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Attempting to bind port 731fa8a4-e27d-4561-a86e-aa21c87548e7 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'}] {{(pid=102317) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:31:34.756598 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Attempting to bind port 731fa8a4-e27d-4561-a86e-aa21c87548e7 on network 185aeb08-41ef-4fae-a420-33296f710850 {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:34.765309 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Port 731fa8a4-e27d-4561-a86e-aa21c87548e7 on network 185aeb08-41ef-4fae-a420-33296f710850 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:31:34.765717 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Attempting to bind port 731fa8a4-e27d-4561-a86e-aa21c87548e7 on network 185aeb08-41ef-4fae-a420-33296f710850 {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:34.776701 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Pushing event updated for resources: {'Port': ['ID=731fa8a4-e27d-4561-a86e-aa21c87548e7,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:34.788699 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 31, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:31:34.789072 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Checking segment: {'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:34.790111 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Bound using segment: {'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'} {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:31:34.791502 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.managers [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Bound port: 731fa8a4-e27d-4561-a86e-aa21c87548e7, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'}}] {{(pid=102317) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:31:34.791867 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:34.831676 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-690a494d-4fa0-45d6-b463-4ee0be012ba8 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=cce62d03291247c8bbba3573a7874355&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8045175 Dec 08 11:31:34.832323 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 49738) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:34.868967 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-690a494d-4fa0-45d6-b463-4ee0be012ba8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa49c145-0536-4c67-bcf5-9b61f6fcd2bd,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:34.919841 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6114b21-624a-4e4e-be02-d048a98e9962 req-86d7e758-6e31-4689-8414-7c18391fceb5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:34.921457 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a6114b21-624a-4e4e-be02-d048a98e9962 req-86d7e758-6e31-4689-8414-7c18391fceb5 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 943 time: 0.3991718 Dec 08 11:31:34.969186 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] For port 731fa8a4-e27d-4561-a86e-aa21c87548e7, host hv-cinder-81977, cleared binding levels {{(pid=102317) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:31:34.974557 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] For port 731fa8a4-e27d-4561-a86e-aa21c87548e7, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=731fa8a4-e27d-4561-a86e-aa21c87548e7,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102317) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:31:34.977348 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1abf5a94-8cca-4ae9-9924-9fd39613b350 req-63fc272c-ce99-4251-a152-e0ee49d8400a service neutron] 10.222.0.61 "GET /v2.0/networks/d0180d44-2173-43bc-b3b2-67db13c39ea0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4658735 Dec 08 11:31:34.990463 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:35.032653 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b16b02b-d2a1-494e-91db-fc120dbb5646 req-e0717ca4-c1b1-4454-ae29-6d014a166a91 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:35.034858 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5b16b02b-d2a1-494e-91db-fc120dbb5646 req-e0717ca4-c1b1-4454-ae29-6d014a166a91 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 943 time: 0.2257543 Dec 08 11:31:35.104712 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a6114b21-624a-4e4e-be02-d048a98e9962 req-b97f94c8-4161-4be8-9d7d-5e0140289cfd tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1668622 Dec 08 11:31:35.113270 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-866527b8-93d5-440d-829a-04e598d2bef1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:35.135404 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:35.136371 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:35.138301 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] 10.222.0.61 "PUT /v2.0/ports/731fa8a4-e27d-4561-a86e-aa21c87548e7 HTTP/1.1" status: 200 len: 1093 time: 1.2192705 Dec 08 11:31:35.139255 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538', 'tag': '731fa8a4-e27d-4561-a86e-aa21c87548e7'}] {{(pid=102317) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:31:35.218133 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-675f4271-eb4b-40ac-9625-3e039e2c23e1 service neutron] Pushing event updated for resources: {'Port': ['ID=731fa8a4-e27d-4561-a86e-aa21c87548e7,revision_number=3']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:35.324093 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-866527b8-93d5-440d-829a-04e598d2bef1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:35.347175 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-35cf2cfc-1fc1-4064-b67f-17ebe2ec7c2e req-3c33d3c9-8248-47f4-a59e-d91c304d31f7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 210 time: 0.1339610 Dec 08 11:31:35.369582 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5b16b02b-d2a1-494e-91db-fc120dbb5646 req-ef38d94b-c80e-48a8-b8f2-d615ca47ca0d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3248849 Dec 08 11:31:35.417498 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-01b5b1ef-b3e7-4a65-9ca6-3fa19a6d6f02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:35.425220 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-01b5b1ef-b3e7-4a65-9ca6-3fa19a6d6f02 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=9c60094b48d34489b46e92ae73d7e33a&device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 1096 time: 0.2090688 Dec 08 11:31:35.505187 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-866527b8-93d5-440d-829a-04e598d2bef1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:35.508869 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-866527b8-93d5-440d-829a-04e598d2bef1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:35.512748 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-866527b8-93d5-440d-829a-04e598d2bef1 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/aa49c145-0536-4c67-bcf5-9b61f6fcd2bd HTTP/1.1" status: 204 len: 168 time: 0.6704941 Dec 08 11:31:35.529675 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-866527b8-93d5-440d-829a-04e598d2bef1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa49c145-0536-4c67-bcf5-9b61f6fcd2bd,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:35.556947 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-f4e440e6-884a-447f-811d-28b3f064c0a7 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=731fa8a4-e27d-4561-a86e-aa21c87548e7 HTTP/1.1" status: 200 len: 217 time: 0.1231878 Dec 08 11:31:35.649105 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b64d4119-1ea1-4f84-a772-38fd49c08113 req-6d27faf0-a13d-430b-b8af-d1f6f7dc7ecf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:35.651021 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b64d4119-1ea1-4f84-a772-38fd49c08113 req-6d27faf0-a13d-430b-b8af-d1f6f7dc7ecf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 944 time: 0.0815516 Dec 08 11:31:35.651262 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49772) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:35.659033 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}212dae370a2b559de5b7d578af79073c1e0f4cb02126db35c6693ef88f95633e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-314643fb-1427-4675-a0df-6cc895c05540" -d '{"events": [{"name": "network-changed", "server_uuid": "6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538", "tag": "731fa8a4-e27d-4561-a86e-aa21c87548e7"}]}' {{(pid=102317) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:31:35.709013 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-bedee8d9-b174-436c-9cb4-7967cd7fb74f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:35.711503 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-bedee8d9-b174-436c-9cb4-7967cd7fb74f service neutron] 10.222.0.61 "GET /v2.0/subnets?id=40a584f7-ce77-4d89-87c2-4f3f589c6700 HTTP/1.1" status: 200 len: 849 time: 0.1374133 Dec 08 11:31:35.716616 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b64d4119-1ea1-4f84-a772-38fd49c08113 req-9d1abf88-f290-485c-8150-527d0fad7385 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0588272 Dec 08 11:31:35.811561 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b9560d12-22c7-4621-8cf8-95d8bedca46b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:35.817086 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-12b4f98f-a1f3-4534-b3c0-0f1bd2c48fed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:35.818595 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-12b4f98f-a1f3-4534-b3c0-0f1bd2c48fed service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=185aeb08-41ef-4fae-a420-33296f710850&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0977206 Dec 08 11:31:35.972893 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-7b4973ad-7a51-4ead-b3a8-f37483234355 service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1434906 Dec 08 11:31:36.040582 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b9560d12-22c7-4621-8cf8-95d8bedca46b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:36.045619 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b9560d12-22c7-4621-8cf8-95d8bedca46b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:36.070314 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:31:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00a6af48-4561-463d-a510-91dbe6b13e60 x-openstack-request-id: req-00a6af48-4561-463d-a510-91dbe6b13e60 {{(pid=102317) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:31:36.070314 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538", "tag": "731fa8a4-e27d-4561-a86e-aa21c87548e7", "status": "completed", "code": 200}]} {{(pid=102317) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:31:36.070648 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-00a6af48-4561-463d-a510-91dbe6b13e60 {{(pid=102317) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:31:36.070909 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538', 'tag': '731fa8a4-e27d-4561-a86e-aa21c87548e7', 'status': 'completed', 'code': 200} Dec 08 11:31:36.119887 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9560d12-22c7-4621-8cf8-95d8bedca46b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aed0ff0c-786b-4593-b9f2-4f1b9c2bec85,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:36.125268 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-b9560d12-22c7-4621-8cf8-95d8bedca46b admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=454339a918d84c189dd76f0d3a5f3af7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4625015 Dec 08 11:31:36.129788 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 49790) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:36.158868 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6e56307f-74a8-425e-8fc0-3ec7b6bb95e0 req-85d72b59-476b-4027-b5e2-14799d9123d2 service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1755970 Dec 08 11:31:36.311395 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49798) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:36.334417 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b63630a7-5be0-4ed3-93b4-2ef5c832ce89 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:36.368056 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9394ba55-c812-49bf-98d2-18f4dffaa8d2 req-b0404e3a-9985-40ae-aebf-653198ca9bee tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:36.376527 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9394ba55-c812-49bf-98d2-18f4dffaa8d2 req-b0404e3a-9985-40ae-aebf-653198ca9bee tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 943 time: 0.1843274 Dec 08 11:31:36.379030 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-314643fb-1427-4675-a0df-6cc895c05540 req-1ea7020a-41ec-4cc2-9a3c-8624d5e86038 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:36.380528 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-314643fb-1427-4675-a0df-6cc895c05540 req-1ea7020a-41ec-4cc2-9a3c-8624d5e86038 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=9c60094b48d34489b46e92ae73d7e33a&device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 1096 time: 0.1310940 Dec 08 11:31:36.382476 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1d763f77-e40f-4c1b-98ab-a2838c1cfb5b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:36.474553 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1d763f77-e40f-4c1b-98ab-a2838c1cfb5b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:36.557554 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-934b37c8-b060-4d75-b50e-8a9ccf045854 req-138f0969-3e15-4b5a-bd63-969fa902ad99 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 210 time: 0.0971823 Dec 08 11:31:36.609570 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b63630a7-5be0-4ed3-93b4-2ef5c832ce89 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:36.613761 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-314643fb-1427-4675-a0df-6cc895c05540 req-430f5b69-d765-47af-a097-9dd6e672a482 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:36.615516 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-314643fb-1427-4675-a0df-6cc895c05540 req-430f5b69-d765-47af-a097-9dd6e672a482 service neutron] 10.222.0.61 "GET /v2.0/networks?id=185aeb08-41ef-4fae-a420-33296f710850 HTTP/1.1" status: 200 len: 911 time: 0.2256241 Dec 08 11:31:36.619295 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9394ba55-c812-49bf-98d2-18f4dffaa8d2 req-a42833ca-2fe8-49bf-af5a-3969bbe98440 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2349019 Dec 08 11:31:36.621498 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b63630a7-5be0-4ed3-93b4-2ef5c832ce89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:36.647101 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a5649b32-8328-4c5a-b355-ae533c8b1a46 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:36.648918 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a5649b32-8328-4c5a-b355-ae533c8b1a46 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.61 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 816 time: 0.3621953 Dec 08 11:31:36.700438 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1d763f77-e40f-4c1b-98ab-a2838c1cfb5b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:36.703809 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1d763f77-e40f-4c1b-98ab-a2838c1cfb5b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:36.705194 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-1d763f77-e40f-4c1b-98ab-a2838c1cfb5b admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/aed0ff0c-786b-4593-b9f2-4f1b9c2bec85 HTTP/1.1" status: 204 len: 168 time: 0.5743840 Dec 08 11:31:36.743367 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d763f77-e40f-4c1b-98ab-a2838c1cfb5b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aed0ff0c-786b-4593-b9f2-4f1b9c2bec85,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:36.767529 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b231ba5f-2224-42f5-b11b-f735a90c59e0 req-30bf00bc-3a2b-4e09-a969-2cbeab2ee9a3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:36.777646 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b231ba5f-2224-42f5-b11b-f735a90c59e0 req-30bf00bc-3a2b-4e09-a969-2cbeab2ee9a3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 943 time: 0.1394937 Dec 08 11:31:36.798883 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-389c196f-f201-4a0e-995e-e85689fa8783 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=44406e332fd94f1a9dcd704577410a61 HTTP/1.1" status: 200 len: 380 time: 0.1385531 Dec 08 11:31:36.815866 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a0923dda-a457-4f87-86ad-7710876e0566 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Request body: {'port': {'device_id': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'admin_state_up': True, 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'security_groups': ['4bc81893-96c8-4fe5-ac25-8ff352618e25']}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:36.864742 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-314643fb-1427-4675-a0df-6cc895c05540 req-f0564685-0a1c-4eeb-be03-86def95c3e42 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=731fa8a4-e27d-4561-a86e-aa21c87548e7 HTTP/1.1" status: 200 len: 217 time: 0.2403591 Dec 08 11:31:36.874950 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-b63630a7-5be0-4ed3-93b4-2ef5c832ce89 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=2a8346fe386049938f859a10e706f500&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5622010 Dec 08 11:31:36.883286 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49830) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:36.884143 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b63630a7-5be0-4ed3-93b4-2ef5c832ce89 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=676c7aa5-8947-4e91-8b88-34cd954fb5d0,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:36.943691 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b231ba5f-2224-42f5-b11b-f735a90c59e0 req-58afe039-04c3-4994-86ee-dc3ec729ef05 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1648371 Dec 08 11:31:36.953114 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-314643fb-1427-4675-a0df-6cc895c05540 req-c7a6b1b4-ce5c-4c79-a2b7-22fab56a04c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:36.954634 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-314643fb-1427-4675-a0df-6cc895c05540 req-c7a6b1b4-ce5c-4c79-a2b7-22fab56a04c0 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=40a584f7-ce77-4d89-87c2-4f3f589c6700 HTTP/1.1" status: 200 len: 849 time: 0.0824761 Dec 08 11:31:36.978752 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb61ba9-de93-45fb-8230-551eeeaec3f4 req-d4cd766b-a955-4a1f-a780-1ddf646475f5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:36.986952 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dcb61ba9-de93-45fb-8230-551eeeaec3f4 req-d4cd766b-a955-4a1f-a780-1ddf646475f5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 944 time: 0.1214590 Dec 08 11:31:37.014604 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6ab48c43-fcf7-433a-bc9e-1f851dae3d0e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.040061 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-314643fb-1427-4675-a0df-6cc895c05540 req-10f77da7-b5ca-4758-bcd7-0e5ed5f6e791 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:37.041740 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-314643fb-1427-4675-a0df-6cc895c05540 req-10f77da7-b5ca-4758-bcd7-0e5ed5f6e791 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=185aeb08-41ef-4fae-a420-33296f710850&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0781112 Dec 08 11:31:37.046925 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6ab48c43-fcf7-433a-bc9e-1f851dae3d0e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.062731 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dcb61ba9-de93-45fb-8230-551eeeaec3f4 req-6633f84a-af5c-4412-8986-141105e54c5e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735490 Dec 08 11:31:37.079322 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a0923dda-a457-4f87-86ad-7710876e0566 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Made reservation on behalf of 44406e332fd94f1a9dcd704577410a61 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:37.079897 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a0923dda-a457-4f87-86ad-7710876e0566 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.188836 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-314643fb-1427-4675-a0df-6cc895c05540 req-aeb41ab5-0ac9-4632-83ac-79cb168e645a service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1347239 Dec 08 11:31:37.189576 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6ab48c43-fcf7-433a-bc9e-1f851dae3d0e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.192115 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6ab48c43-fcf7-433a-bc9e-1f851dae3d0e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.195899 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-6ab48c43-fcf7-433a-bc9e-1f851dae3d0e admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/676c7aa5-8947-4e91-8b88-34cd954fb5d0 HTTP/1.1" status: 204 len: 168 time: 0.3061149 Dec 08 11:31:37.229083 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ab48c43-fcf7-433a-bc9e-1f851dae3d0e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=676c7aa5-8947-4e91-8b88-34cd954fb5d0,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:37.291213 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a0923dda-a457-4f87-86ad-7710876e0566 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Allocated IP 172.20.0.10 (fd37a1fc-3614-462b-92a2-b41260c949a2/62551f0b-3202-4a06-842d-a67bd8fa187b/2ebdbac7-6fba-4bd2-bbec-7e49216db3fe) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:31:37.332901 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 49848) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:37.351101 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-314643fb-1427-4675-a0df-6cc895c05540 req-8fb5e1f9-ba3a-49b7-94ce-2bc6650d0481 service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1544838 Dec 08 11:31:37.356167 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-78f3029c-72f1-48b1-a62f-014929c2f40b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.515743 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a0923dda-a457-4f87-86ad-7710876e0566 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.539482 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-78f3029c-72f1-48b1-a62f-014929c2f40b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.545177 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-78f3029c-72f1-48b1-a62f-014929c2f40b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.641450 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f3029c-72f1-48b1-a62f-014929c2f40b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9724d7e1-5a0e-4f79-a9bd-6aa609483949,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:37.663549 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49872) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:37.664337 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-78f3029c-72f1-48b1-a62f-014929c2f40b admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=62d775592c9d4d5ebeb451999c39655f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3302531 Dec 08 11:31:37.712311 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ff1e9c9d-0653-4cee-bc40-980f98b65667 req-7624fe13-72e8-4ef3-b51c-517ced3c54f2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 210 time: 0.0468392 Dec 08 11:31:37.714068 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a0923dda-a457-4f87-86ad-7710876e0566 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.725543 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5b29a1ee-8f58-41c3-b4c6-a6503843c056 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.752170 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5b29a1ee-8f58-41c3-b4c6-a6503843c056 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.778423 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 49874) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:37.808114 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5b29a1ee-8f58-41c3-b4c6-a6503843c056 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.809462 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a0923dda-a457-4f87-86ad-7710876e0566 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Network fd37a1fc-3614-462b-92a2-b41260c949a2 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:31:37.811386 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5b29a1ee-8f58-41c3-b4c6-a6503843c056 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.812760 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-5b29a1ee-8f58-41c3-b4c6-a6503843c056 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/9724d7e1-5a0e-4f79-a9bd-6aa609483949 HTTP/1.1" status: 204 len: 168 time: 0.1480973 Dec 08 11:31:37.818160 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0923dda-a457-4f87-86ad-7710876e0566 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event updated for resources: {'Port': ['ID=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:37.821357 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b29a1ee-8f58-41c3-b4c6-a6503843c056 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9724d7e1-5a0e-4f79-a9bd-6aa609483949,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:37.830695 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a0923dda-a457-4f87-86ad-7710876e0566 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:37.835871 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a0923dda-a457-4f87-86ad-7710876e0566 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:31:37.842119 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a0923dda-a457-4f87-86ad-7710876e0566 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:37.842652 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a0923dda-a457-4f87-86ad-7710876e0566 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:37.854982 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf3c249-b86f-47d5-9215-0edaa08c90f3 req-a2f86623-480a-4e50-b6ac-5d02c7cd5ceb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:37.865458 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4bf3c249-b86f-47d5-9215-0edaa08c90f3 req-a2f86623-480a-4e50-b6ac-5d02c7cd5ceb tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 943 time: 0.1558793 Dec 08 11:31:37.896320 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a0923dda-a457-4f87-86ad-7710876e0566 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0843084 Dec 08 11:31:37.934053 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Request body: {'port': {'device_id': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:37.945220 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4bf3c249-b86f-47d5-9215-0edaa08c90f3 req-5977465f-549a-4647-977b-8ca6ab00317d tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788231 Dec 08 11:31:37.987426 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9f116182-8d45-4953-a5ea-040b151441c3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.094485 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.146994 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 8e4b1127-3db2-4f93-a731-315192c060b3 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:31:38.162719 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20fcd7b4-18ee-491b-9e10-a5dbda4bc9ea req-17fbd726-7a81-40d4-8df4-b8c410ce9006 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:38.164399 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20fcd7b4-18ee-491b-9e10-a5dbda4bc9ea req-17fbd726-7a81-40d4-8df4-b8c410ce9006 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 943 time: 0.1322181 Dec 08 11:31:38.213331 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-9c9d675b-af44-45b9-85cb-e4d075ddec4b None None] Provisioning complete for port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:38.213503 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9c9d675b-af44-45b9-85cb-e4d075ddec4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.306271 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-9c9d675b-af44-45b9-85cb-e4d075ddec4b None None] Port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:31:38.342152 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 8e4b1127-3db2-4f93-a731-315192c060b3, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=8e4b1127-3db2-4f93-a731-315192c060b3,segment=NetworkSegment(5be28b76-0677-4ab9-a950-5242cff71605),segment_id=5be28b76-0677-4ab9-a950-5242cff71605)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:38.357223 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '8e4b1127-3db2-4f93-a731-315192c060b3', 'network_id': 'd0180d44-2173-43bc-b3b2-67db13c39ea0', 'port_id': '8e4b1127-3db2-4f93-a731-315192c060b3', 'mac_address': 'fa:16:3e:7b:d8:c3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 295, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2d9f9ed3-4577-43a0-80bf-cc86dab7d362', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:31:38.375626 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9f116182-8d45-4953-a5ea-040b151441c3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.388452 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20fcd7b4-18ee-491b-9e10-a5dbda4bc9ea req-1517318c-3336-4725-a067-e1644562b169 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2008088 Dec 08 11:31:38.403396 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9f116182-8d45-4953-a5ea-040b151441c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.413083 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-355e73dc-6c6a-4375-beba-55a8ea63158c req-35ace89a-c3a6-4ed1-a37d-d2c55e852839 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:38.415770 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-355e73dc-6c6a-4375-beba-55a8ea63158c req-35ace89a-c3a6-4ed1-a37d-d2c55e852839 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 944 time: 0.2241526 Dec 08 11:31:38.425091 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.442365 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8e4b1127-3db2-4f93-a731-315192c060b3 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:31:38.476211 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 8e4b1127-3db2-4f93-a731-315192c060b3, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=8e4b1127-3db2-4f93-a731-315192c060b3,segment=NetworkSegment(5be28b76-0677-4ab9-a950-5242cff71605),segment_id=5be28b76-0677-4ab9-a950-5242cff71605)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:38.482020 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.482678 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device d9ecab87-157e-4ccb-8423-2248bb8451ea details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:31:38.512697 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-9f116182-8d45-4953-a5ea-040b151441c3 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=c620a623e36f474aa77e5de9974b8a26&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7312214 Dec 08 11:31:38.513093 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49908) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:38.523080 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f116182-8d45-4953-a5ea-040b151441c3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e1ee1cb-6ab1-4ca4-8877-2c7cd975ce21,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:38.589867 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=8e4b1127-3db2-4f93-a731-315192c060b3,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:38.605981 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbe904c5-0794-4c58-9e11-818bc85696d0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.606575 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-355e73dc-6c6a-4375-beba-55a8ea63158c req-e88e9139-7e13-4975-9c71-1b15e403f6e1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1585062 Dec 08 11:31:38.659882 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port d9ecab87-157e-4ccb-8423-2248bb8451ea, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d9ecab87-157e-4ccb-8423-2248bb8451ea,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:38.675153 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': 'd9ecab87-157e-4ccb-8423-2248bb8451ea', 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919', 'port_id': 'd9ecab87-157e-4ccb-8423-2248bb8451ea', 'mac_address': 'fa:16:3e:1d:18:70', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 277, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd6b1fb0e-d38f-47ca-a647-53b824c47e76', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:31:38.682992 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbe904c5-0794-4c58-9e11-818bc85696d0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.725018 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.745392 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d9ecab87-157e-4ccb-8423-2248bb8451ea {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:31:38.768754 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:31:38.788143 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port d9ecab87-157e-4ccb-8423-2248bb8451ea, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d9ecab87-157e-4ccb-8423-2248bb8451ea,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:38.799525 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.799680 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbe904c5-0794-4c58-9e11-818bc85696d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.800480 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.802573 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbe904c5-0794-4c58-9e11-818bc85696d0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.809681 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-bbe904c5-0794-4c58-9e11-818bc85696d0 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/5e1ee1cb-6ab1-4ca4-8877-2c7cd975ce21 HTTP/1.1" status: 204 len: 168 time: 0.2934489 Dec 08 11:31:38.817434 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Transition to ACTIVE for port object 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:31:38.822402 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:38.829627 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbe904c5-0794-4c58-9e11-818bc85696d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e1ee1cb-6ab1-4ca4-8877-2c7cd975ce21,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:38.933540 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=d9ecab87-157e-4ccb-8423-2248bb8451ea,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:38.998236 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Attempting to bind port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:31:38.998658 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Attempting to bind port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:31:38.999049 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Attempting to bind port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe on network fd37a1fc-3614-462b-92a2-b41260c949a2 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:39.022164 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Pushing event updated for resources: {'Port': ['ID=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:39.028574 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe on network fd37a1fc-3614-462b-92a2-b41260c949a2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:31:39.028983 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Attempting to bind port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe on network fd37a1fc-3614-462b-92a2-b41260c949a2 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:31:39.053389 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d64329a7-6a25-4586-a911-427549a2017f req-f5fcd546-0501-4a2b-a5f4-4256d3c226cd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:39.063051 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d64329a7-6a25-4586-a911-427549a2017f req-f5fcd546-0501-4a2b-a5f4-4256d3c226cd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.1948476 Dec 08 11:31:39.073666 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 31, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:31:39.074000 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Checking segment: {'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:39.074517 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Bound using segment: {'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:31:39.075143 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Bound port: 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:31:39.075505 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:39.174831 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['8e4b1127-3db2-4f93-a731-315192c060b3'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:31:39.214288 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34127e28-c65d-4901-bc84-9065edc57746 req-680362fd-cdcb-417a-a115-8572db3b9d0a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:39.221458 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-34127e28-c65d-4901-bc84-9065edc57746 req-680362fd-cdcb-417a-a115-8572db3b9d0a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 944 time: 0.1553969 Dec 08 11:31:39.247066 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['d9ecab87-157e-4ccb-8423-2248bb8451ea'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:31:39.263723 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d64329a7-6a25-4586-a911-427549a2017f req-99e94d87-e411-4099-954f-f4692d88e3bb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1995423 Dec 08 11:31:39.326997 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-34127e28-c65d-4901-bc84-9065edc57746 req-3c699a2e-2336-4a32-b6a3-ea4287909d61 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1045997 Dec 08 11:31:39.330420 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] For port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:31:39.337061 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] For port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:31:39.358817 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:39.408471 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:39.409522 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:39.412844 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] 10.222.0.61 "PUT /v2.0/ports/2ebdbac7-6fba-4bd2-bbec-7e49216db3fe HTTP/1.1" status: 200 len: 1094 time: 1.4861267 Dec 08 11:31:39.422338 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:31:39.426181 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668" -d '{"events": [{"name": "network-changed", "server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:31:39.530836 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 49958) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:39.558929 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-90f5088b-12ca-483f-8a4d-7b497d928689 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:39.771616 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-90f5088b-12ca-483f-8a4d-7b497d928689 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:39.777975 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-90f5088b-12ca-483f-8a4d-7b497d928689 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:39.810722 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f5088b-12ca-483f-8a4d-7b497d928689 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7c7bc2bf-0273-4c97-b6f7-eba098a70ab9,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:39.832009 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-90f5088b-12ca-483f-8a4d-7b497d928689 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=e09b0b16d9394540bf9f513cbb8c1175&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2982287 Dec 08 11:31:39.834738 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50000) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:39.846368 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:31:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3fce56af-464b-4ca7-bb68-3581828d941d x-openstack-request-id: req-3fce56af-464b-4ca7-bb68-3581828d941d {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:31:39.846853 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:31:39.846967 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-3fce56af-464b-4ca7-bb68-3581828d941d {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:31:39.847274 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'status': 'completed', 'code': 200} Dec 08 11:31:39.896289 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-907707b3-1522-4b73-8abd-24f288e9dad3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:39.921831 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-907707b3-1522-4b73-8abd-24f288e9dad3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:39.943036 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6667afb8-87cc-42d4-9a4f-85534f2b200b service neutron] Pushing event updated for resources: {'Port': ['ID=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:39.968159 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-288d544a-5286-4442-99af-2ff83963530c req-9ee97e41-9797-433c-b76f-f432485929bd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:39.969821 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-288d544a-5286-4442-99af-2ff83963530c req-9ee97e41-9797-433c-b76f-f432485929bd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 943 time: 0.1548429 Dec 08 11:31:39.975060 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-caf0d61f-f632-4310-8338-640f966640fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:39.977643 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-caf0d61f-f632-4310-8338-640f966640fd service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 1097 time: 0.5193493 Dec 08 11:31:39.989301 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-893ff28a-adf7-48dd-938f-ce7a5f4eb0f2 req-3e782827-7d0f-42d5-b4a5-6a590eb958be tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:39.997091 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-907707b3-1522-4b73-8abd-24f288e9dad3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:39.998239 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-893ff28a-adf7-48dd-938f-ce7a5f4eb0f2 req-3e782827-7d0f-42d5-b4a5-6a590eb958be tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 945 time: 0.1495540 Dec 08 11:31:40.000938 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-907707b3-1522-4b73-8abd-24f288e9dad3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:40.003293 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-907707b3-1522-4b73-8abd-24f288e9dad3 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/7c7bc2bf-0273-4c97-b6f7-eba098a70ab9 HTTP/1.1" status: 204 len: 168 time: 0.1665273 Dec 08 11:31:40.012316 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-907707b3-1522-4b73-8abd-24f288e9dad3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7c7bc2bf-0273-4c97-b6f7-eba098a70ab9,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:40.079563 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-66487e71-2822-4b25-9065-0fcc87bc1cc4 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe HTTP/1.1" status: 200 len: 217 time: 0.0789270 Dec 08 11:31:40.134172 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 731fa8a4-e27d-4561-a86e-aa21c87548e7 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:31:40.172813 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-288d544a-5286-4442-99af-2ff83963530c req-d95896ec-beed-4030-88a4-7d19a4c405ca tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1710532 Dec 08 11:31:40.181193 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-893ff28a-adf7-48dd-938f-ce7a5f4eb0f2 req-971f26e7-db92-4459-87ba-29ccc5d9ff87 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1820092 Dec 08 11:31:40.185018 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-08523c07-2072-4714-ab1c-f46b6bfcf140 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:40.187039 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-08523c07-2072-4714-ab1c-f46b6bfcf140 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 200 len: 855 time: 0.0891945 Dec 08 11:31:40.266818 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-55fb357a-fb66-4b4d-8d4e-f1edf016c560 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:40.268837 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-55fb357a-fb66-4b4d-8d4e-f1edf016c560 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=fd37a1fc-3614-462b-92a2-b41260c949a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0734589 Dec 08 11:31:40.467796 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 731fa8a4-e27d-4561-a86e-aa21c87548e7, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=731fa8a4-e27d-4561-a86e-aa21c87548e7,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:40.482536 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '731fa8a4-e27d-4561-a86e-aa21c87548e7', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'port_id': '731fa8a4-e27d-4561-a86e-aa21c87548e7', 'mac_address': 'fa:16:3e:76:9b:24', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 296, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:31:40.537240 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:40.562547 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 731fa8a4-e27d-4561-a86e-aa21c87548e7 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:31:40.598520 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 731fa8a4-e27d-4561-a86e-aa21c87548e7, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=731fa8a4-e27d-4561-a86e-aa21c87548e7,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:40.600449 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-a1b745d7-2310-46a3-ba73-4ef3ff9548a0 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3220751 Dec 08 11:31:40.604441 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:40.627982 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d4ad6a-7fc3-4106-9537-c44ded012e0c req-c77eb207-b2d2-4584-ac18-ba08752bbf29 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:40.648601 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-11d4ad6a-7fc3-4106-9537-c44ded012e0c req-c77eb207-b2d2-4584-ac18-ba08752bbf29 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.2197030 Dec 08 11:31:40.676169 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dbffce1-725a-4ec2-ba15-53b1121ce064 req-146e197d-1d4b-4e26-af73-8458eb83f765 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:40.677834 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9dbffce1-725a-4ec2-ba15-53b1121ce064 req-146e197d-1d4b-4e26-af73-8458eb83f765 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 944 time: 0.1817057 Dec 08 11:31:40.704427 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=731fa8a4-e27d-4561-a86e-aa21c87548e7,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:40.820855 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9dbffce1-725a-4ec2-ba15-53b1121ce064 req-a89f51ac-c5e4-4ba1-a538-dfeaa0841575 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1313615 Dec 08 11:31:40.850702 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-11d4ad6a-7fc3-4106-9537-c44ded012e0c req-ec2cc773-d4ae-4f7e-8b15-2af7fc6569d8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2010801 Dec 08 11:31:40.873097 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e6c2b308-d9c0-403f-b176-ee10abd8104e req-95d1c1a8-c76e-44b5-a7b7-034f8828fbae service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2547579 Dec 08 11:31:40.950662 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['731fa8a4-e27d-4561-a86e-aa21c87548e7'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:31:40.973673 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-65f96684-6b84-4b12-9472-2dedf52a9ff9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:40.976379 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-65f96684-6b84-4b12-9472-2dedf52a9ff9 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 1097 time: 0.0489159 Dec 08 11:31:41.065212 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50094) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:41.097280 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-3b568b88-0877-48a6-af6b-5746537a5c0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:41.097280 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-3b568b88-0877-48a6-af6b-5746537a5c0c service neutron] 10.222.0.61 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 917 time: 0.1096857 Dec 08 11:31:41.147652 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-9327a57a-7e6a-49da-aeef-f2aea406ec05 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe HTTP/1.1" status: 200 len: 217 time: 0.0448496 Dec 08 11:31:41.218275 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-3e81fc4e-84d5-4960-8266-1c28c5b78f99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:41.219997 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-3e81fc4e-84d5-4960-8266-1c28c5b78f99 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 200 len: 855 time: 0.0643113 Dec 08 11:31:41.220236 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-842aae77-e991-404f-8c77-1755990b803b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:41.349302 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-842aae77-e991-404f-8c77-1755990b803b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:41.361722 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-842aae77-e991-404f-8c77-1755990b803b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:41.373396 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-dcbf22aa-8e9e-4e34-bce7-f393ec374dd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:41.375006 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-dcbf22aa-8e9e-4e34-bce7-f393ec374dd3 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=fd37a1fc-3614-462b-92a2-b41260c949a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1467357 Dec 08 11:31:41.405616 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-842aae77-e991-404f-8c77-1755990b803b admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=d7121accf1c64eb384e189873cc8dc04&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3390691 Dec 08 11:31:41.410473 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50110) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:41.423595 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1afe0bd2-be0d-40d0-b8a0-953e018e0215 req-053459b6-b00a-423e-a88a-c4acdaf68374 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:41.425080 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1afe0bd2-be0d-40d0-b8a0-953e018e0215 req-053459b6-b00a-423e-a88a-c4acdaf68374 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 944 time: 0.1358066 Dec 08 11:31:41.426435 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-842aae77-e991-404f-8c77-1755990b803b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b8a33549-1e4a-4f8a-808b-4f8682533353,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:41.465979 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2559be8-d3fe-4506-ad79-4f1e458f2a7b req-da62e36f-b5f9-483c-ad1a-801511cc6e9f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:41.467469 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a2559be8-d3fe-4506-ad79-4f1e458f2a7b req-da62e36f-b5f9-483c-ad1a-801511cc6e9f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 945 time: 0.1800914 Dec 08 11:31:41.481069 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-fd3be310-66e4-42bf-8c2b-aaf52a6573f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:41.507333 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-fd3be310-66e4-42bf-8c2b-aaf52a6573f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:41.575065 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1afe0bd2-be0d-40d0-b8a0-953e018e0215 req-f35d28be-ca0c-4fb4-a772-3f6dde975d05 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1034303 Dec 08 11:31:41.583741 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-fd3be310-66e4-42bf-8c2b-aaf52a6573f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:41.586047 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-2868b6e9-0aa4-467f-a159-36725c714f4c service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1975064 Dec 08 11:31:41.588259 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-fd3be310-66e4-42bf-8c2b-aaf52a6573f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:41.589425 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-fd3be310-66e4-42bf-8c2b-aaf52a6573f6 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/b8a33549-1e4a-4f8a-808b-4f8682533353 HTTP/1.1" status: 204 len: 168 time: 0.1780112 Dec 08 11:31:41.589656 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a2559be8-d3fe-4506-ad79-4f1e458f2a7b req-41c29e66-9458-4dbe-a0a8-07130e69a6dd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1117468 Dec 08 11:31:41.616954 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd3be310-66e4-42bf-8c2b-aaf52a6573f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b8a33549-1e4a-4f8a-808b-4f8682533353,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:41.719803 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bb0fa051-19e4-4d43-b2fe-af6bbcff0668 req-9d1e119d-eadf-4d3e-8a93-587792f07998 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1244178 Dec 08 11:31:42.001840 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15a456bb-1b4d-478b-af2d-51e8c7cb71a9 req-6b59babe-b4b6-4550-87e6-01f4fda88960 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:42.003523 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-15a456bb-1b4d-478b-af2d-51e8c7cb71a9 req-6b59babe-b4b6-4550-87e6-01f4fda88960 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 944 time: 0.0976439 Dec 08 11:31:42.072477 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50144) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:42.081711 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-15a456bb-1b4d-478b-af2d-51e8c7cb71a9 req-f829e573-ccf2-438e-8be8-704067a54a37 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624340 Dec 08 11:31:42.094019 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-181f6b32-c219-4d32-a9ba-f85abe627244 req-5326fbd8-15b9-4780-b6a4-8e02cf2a8edf tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:42.095770 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-181f6b32-c219-4d32-a9ba-f85abe627244 req-5326fbd8-15b9-4780-b6a4-8e02cf2a8edf tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.1270943 Dec 08 11:31:42.113524 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6eedf304-b825-42f5-9c98-74943ea1742d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:42.160284 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 731fa8a4-e27d-4561-a86e-aa21c87548e7 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:42.165943 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-181f6b32-c219-4d32-a9ba-f85abe627244 req-5524b3b6-bd41-49b8-91fa-0cb7799cd2b5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0567083 Dec 08 11:31:42.240134 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 731fa8a4-e27d-4561-a86e-aa21c87548e7 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:31:42.241952 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6eedf304-b825-42f5-9c98-74943ea1742d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:42.245993 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 731fa8a4-e27d-4561-a86e-aa21c87548e7 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:42.246570 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:42.247261 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6eedf304-b825-42f5-9c98-74943ea1742d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:42.306231 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-6eedf304-b825-42f5-9c98-74943ea1742d admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=b21bee4e58354babaf1655748a1c80a7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2308187 Dec 08 11:31:42.309501 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 50162) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:42.316853 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6eedf304-b825-42f5-9c98-74943ea1742d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a365ec8f-8460-4bd4-8c83-5fd9670777c1,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:42.365169 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:42.400213 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '731fa8a4-e27d-4561-a86e-aa21c87548e7'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:31:42.419266 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-141e07d2-6ece-44bf-92ea-7dc2b91cb6ff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:42.443804 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-141e07d2-6ece-44bf-92ea-7dc2b91cb6ff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:42.505113 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-141e07d2-6ece-44bf-92ea-7dc2b91cb6ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:42.508743 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-141e07d2-6ece-44bf-92ea-7dc2b91cb6ff admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:42.510010 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-141e07d2-6ece-44bf-92ea-7dc2b91cb6ff admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/a365ec8f-8460-4bd4-8c83-5fd9670777c1 HTTP/1.1" status: 204 len: 168 time: 0.1991055 Dec 08 11:31:42.518275 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-141e07d2-6ece-44bf-92ea-7dc2b91cb6ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a365ec8f-8460-4bd4-8c83-5fd9670777c1,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:42.520816 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 731fa8a4-e27d-4561-a86e-aa21c87548e7, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=731fa8a4-e27d-4561-a86e-aa21c87548e7,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:42.526360 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:42.527273 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 8e4b1127-3db2-4f93-a731-315192c060b3 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:42.621034 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=731fa8a4-e27d-4561-a86e-aa21c87548e7,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:42.640383 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 8e4b1127-3db2-4f93-a731-315192c060b3 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:31:42.645327 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 8e4b1127-3db2-4f93-a731-315192c060b3 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:42.645802 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:42.693494 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6424d7e3-dc26-4825-be95-862cbfa7d29d" -d '{"events": [{"server_uuid": "6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538", "name": "network-vif-plugged", "status": "completed", "tag": "731fa8a4-e27d-4561-a86e-aa21c87548e7"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:31:42.748909 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50186) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:42.752314 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:42.781100 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:31:42.814976 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90aaecb0-7925-47a3-bfc6-9112936c9243 req-ce1a7870-4e73-4ee4-b544-4ad3e92d767c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:42.819242 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 8e4b1127-3db2-4f93-a731-315192c060b3, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=8e4b1127-3db2-4f93-a731-315192c060b3,segment=NetworkSegment(5be28b76-0677-4ab9-a950-5242cff71605),segment_id=5be28b76-0677-4ab9-a950-5242cff71605)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:42.825251 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-90aaecb0-7925-47a3-bfc6-9112936c9243 req-ce1a7870-4e73-4ee4-b544-4ad3e92d767c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 945 time: 0.1376302 Dec 08 11:31:42.825501 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:42.827079 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device d9ecab87-157e-4ccb-8423-2248bb8451ea up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:42.858845 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6462549-1f61-4fd6-9d7a-1aa73c821bfd req-5e197365-9fb4-48e6-9f98-f097a9914739 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:42.867008 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c6462549-1f61-4fd6-9d7a-1aa73c821bfd req-5e197365-9fb4-48e6-9f98-f097a9914739 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.1355872 Dec 08 11:31:42.952153 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c6462549-1f61-4fd6-9d7a-1aa73c821bfd req-028914bf-a2c5-4e78-88dd-ee2dded40a96 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0839570 Dec 08 11:31:42.956182 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-90aaecb0-7925-47a3-bfc6-9112936c9243 req-5c998869-dc42-4d2d-ad12-06f8ddf213a7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1299527 Dec 08 11:31:43.034722 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=8e4b1127-3db2-4f93-a731-315192c060b3,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:43.072372 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port d9ecab87-157e-4ccb-8423-2248bb8451ea completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:31:43.081214 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port d9ecab87-157e-4ccb-8423-2248bb8451ea triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:43.081635 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:43.098256 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-29aadb57-422c-4373-8224-43770601b9c1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:43.213061 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-29aadb57-422c-4373-8224-43770601b9c1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:43.220323 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-29aadb57-422c-4373-8224-43770601b9c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:43.261567 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4629b41c-f77a-4dc7-b2fa-cdeee05cdaba req-b91af181-854c-4477-92e3-a0d1a53a2b30 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:43.275021 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4629b41c-f77a-4dc7-b2fa-cdeee05cdaba req-b91af181-854c-4477-92e3-a0d1a53a2b30 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 945 time: 0.0739298 Dec 08 11:31:43.279472 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:43.287505 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-29aadb57-422c-4373-8224-43770601b9c1 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=4f0abab29194439587b5312ad6170672&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5374126 Dec 08 11:31:43.288137 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50208) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:43.304968 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:31:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3d8dd57b-0714-4740-a131-705d4b0844bf x-openstack-request-id: req-3d8dd57b-0714-4740-a131-705d4b0844bf {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:31:43.305926 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538", "name": "network-vif-plugged", "status": "completed", "tag": "731fa8a4-e27d-4561-a86e-aa21c87548e7", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:31:43.310387 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-3d8dd57b-0714-4740-a131-705d4b0844bf {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:31:43.310542 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '731fa8a4-e27d-4561-a86e-aa21c87548e7', 'code': 200} Dec 08 11:31:43.340500 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29aadb57-422c-4373-8224-43770601b9c1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=66e2d2de-f09e-4d89-8889-fef3edbde0a5,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:43.378193 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port d9ecab87-157e-4ccb-8423-2248bb8451ea, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d9ecab87-157e-4ccb-8423-2248bb8451ea,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:43.390733 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:43.413498 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-60d8fb08-5b5a-4d7d-a032-b5077744e26b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:43.465796 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4629b41c-f77a-4dc7-b2fa-cdeee05cdaba req-35ace5b1-a8ed-4a13-8a23-25c31c72bbda tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1898060 Dec 08 11:31:43.477936 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-60d8fb08-5b5a-4d7d-a032-b5077744e26b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:43.507427 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-928931ec-b44e-4a82-be61-ba5326665553 req-58dbd55b-2f86-4ab4-8b52-4a5b0597c794 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:43.521201 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-928931ec-b44e-4a82-be61-ba5326665553 req-58dbd55b-2f86-4ab4-8b52-4a5b0597c794 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.1483972 Dec 08 11:31:43.530996 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=d9ecab87-157e-4ccb-8423-2248bb8451ea,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:43.563049 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-60d8fb08-5b5a-4d7d-a032-b5077744e26b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:43.565760 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-60d8fb08-5b5a-4d7d-a032-b5077744e26b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:43.572862 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-60d8fb08-5b5a-4d7d-a032-b5077744e26b admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/66e2d2de-f09e-4d89-8889-fef3edbde0a5 HTTP/1.1" status: 204 len: 168 time: 0.2792356 Dec 08 11:31:43.589028 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60d8fb08-5b5a-4d7d-a032-b5077744e26b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=66e2d2de-f09e-4d89-8889-fef3edbde0a5,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:43.661649 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-928931ec-b44e-4a82-be61-ba5326665553 req-fe9fc169-4644-42a7-b766-f2cde59fd29e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1350877 Dec 08 11:31:43.664708 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36c3a05-4ad5-476d-bc90-4c9e5b8d7a73 req-05a8414b-c076-4bb0-a034-bb7bf1f9511a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:43.666499 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d36c3a05-4ad5-476d-bc90-4c9e5b8d7a73 req-05a8414b-c076-4bb0-a034-bb7bf1f9511a service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 1098 time: 0.1387200 Dec 08 11:31:43.700198 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d36c3a05-4ad5-476d-bc90-4c9e5b8d7a73 req-ce53589a-c0b0-42e3-ab0c-599e6643eccd service neutron] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:43.784626 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d36c3a05-4ad5-476d-bc90-4c9e5b8d7a73 req-ce53589a-c0b0-42e3-ab0c-599e6643eccd service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:43.789137 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d36c3a05-4ad5-476d-bc90-4c9e5b8d7a73 req-ce53589a-c0b0-42e3-ab0c-599e6643eccd service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:43.840502 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d36c3a05-4ad5-476d-bc90-4c9e5b8d7a73 req-ce53589a-c0b0-42e3-ab0c-599e6643eccd service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1644192 Dec 08 11:31:43.841399 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce53589a-c0b0-42e3-ab0c-599e6643eccd service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=815f209b-a45e-4099-b7bd-4088e0fd4fce,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:44.110043 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50240) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:44.128726 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a46406b7-a0eb-4ff7-9812-1cb331675e2e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:44.179156 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:31:44.182647 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b271f909-3e65-4964-9f68-b1178eb84246 req-94391747-899f-4ad5-a158-6d78691c72f7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:44.184245 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b271f909-3e65-4964-9f68-b1178eb84246 req-94391747-899f-4ad5-a158-6d78691c72f7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 946 time: 0.0935867 Dec 08 11:31:44.197703 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-861ab077-ab01-46ac-9264-7d4ea8d6af68 req-e1dfae7f-573a-461e-94b3-79aca27fdb5b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:44.199001 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-861ab077-ab01-46ac-9264-7d4ea8d6af68 req-e1dfae7f-573a-461e-94b3-79aca27fdb5b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.1486211 Dec 08 11:31:44.274226 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b271f909-3e65-4964-9f68-b1178eb84246 req-5dcf6825-830a-40ff-8e90-b77fc0936de1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741522 Dec 08 11:31:44.281570 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-861ab077-ab01-46ac-9264-7d4ea8d6af68 req-643e2076-f331-4e65-865e-edd6a17e00eb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0748339 Dec 08 11:31:44.285139 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a46406b7-a0eb-4ff7-9812-1cb331675e2e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:44.291107 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a46406b7-a0eb-4ff7-9812-1cb331675e2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:44.333350 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-a46406b7-a0eb-4ff7-9812-1cb331675e2e admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=070cdda10da348b3bce71792576f8741&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2219622 Dec 08 11:31:44.337410 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 50252) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:44.368969 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a46406b7-a0eb-4ff7-9812-1cb331675e2e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f98416ee-48af-48aa-ab5f-98558116b91c,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:44.370956 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:44.402106 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'port_id': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'mac_address': 'fa:16:3e:f5:f7:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 278, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:31:44.406184 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-965ba3b5-5f5c-4cad-aa94-082281962810 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:44.445282 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-965ba3b5-5f5c-4cad-aa94-082281962810 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:44.450443 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:44.472740 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:31:44.503654 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:44.508163 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:44.530872 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-965ba3b5-5f5c-4cad-aa94-082281962810 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:44.534291 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-965ba3b5-5f5c-4cad-aa94-082281962810 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:44.535372 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-965ba3b5-5f5c-4cad-aa94-082281962810 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/f98416ee-48af-48aa-ab5f-98558116b91c HTTP/1.1" status: 204 len: 168 time: 0.1968555 Dec 08 11:31:44.547516 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-965ba3b5-5f5c-4cad-aa94-082281962810 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f98416ee-48af-48aa-ab5f-98558116b91c,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:44.584688 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:44.607955 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50266) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:44.639658 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa0b8d0f-d9ce-4be8-92f9-f1e6de2772be req-083727f4-865a-43ec-a876-42b5b6dced56 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:44.641731 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fa0b8d0f-d9ce-4be8-92f9-f1e6de2772be req-083727f4-865a-43ec-a876-42b5b6dced56 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 945 time: 0.0754144 Dec 08 11:31:44.700810 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fa0b8d0f-d9ce-4be8-92f9-f1e6de2772be req-35608f3d-a6c0-43dd-87ff-517ae4750987 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519016 Dec 08 11:31:44.793640 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a598212d-524e-47b4-8861-72f3dffc8830 req-8a14b6a8-8051-4e85-86a8-faece2b93ee7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:44.795045 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a598212d-524e-47b4-8861-72f3dffc8830 req-8a14b6a8-8051-4e85-86a8-faece2b93ee7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 945 time: 0.0509529 Dec 08 11:31:44.845183 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a598212d-524e-47b4-8861-72f3dffc8830 req-855cb790-6246-4baf-b6fc-273080f1ce61 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437562 Dec 08 11:31:44.890381 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50278) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:44.917640 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0696f954-77ae-4faa-8ecf-8227b5b8d2f2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:44.924286 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['2ebdbac7-6fba-4bd2-bbec-7e49216db3fe'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:31:44.967080 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-829a2705-de2c-41fc-9683-629d50b2956d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:45.059409 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0696f954-77ae-4faa-8ecf-8227b5b8d2f2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:45.064933 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0696f954-77ae-4faa-8ecf-8227b5b8d2f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:45.125616 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-0696f954-77ae-4faa-8ecf-8227b5b8d2f2 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=77dd3243c83849388fe68cb8e7da9615&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5162759 Dec 08 11:31:45.128420 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50288) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:45.144112 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0696f954-77ae-4faa-8ecf-8227b5b8d2f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a8b8278-3a88-450a-a98b-f56b0eeba810,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:45.156600 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-829a2705-de2c-41fc-9683-629d50b2956d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:45.166186 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-829a2705-de2c-41fc-9683-629d50b2956d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:45.224714 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-829a2705-de2c-41fc-9683-629d50b2956d admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=a3452a01fd3245a393dc8fe1bf634054&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3333304 Dec 08 11:31:45.227375 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 50296) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:45.228336 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-829a2705-de2c-41fc-9683-629d50b2956d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7a21861d-2395-4936-ba16-957181b181a8,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:45.244071 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-823c9083-75ed-4fa8-9b17-9f858f161f7d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:45.266440 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-823c9083-75ed-4fa8-9b17-9f858f161f7d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:45.284054 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3fb0f36e-fc2a-47e5-9a6d-6f40cbf1649c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:45.311062 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3fb0f36e-fc2a-47e5-9a6d-6f40cbf1649c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:45.311671 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fe445662-9a2d-4c17-96ea-b054be927e53', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8e4b1127-3db2-4f93-a731-315192c060b3'}, {'server_uuid': 'c7fa09fb-ae2b-4479-8848-f142131fe33a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9ecab87-157e-4ccb-8423-2248bb8451ea'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:31:45.327616 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4807aea9-9339-4e2c-9a9d-5780d68f0fe5" -d '{"events": [{"server_uuid": "fe445662-9a2d-4c17-96ea-b054be927e53", "name": "network-vif-plugged", "status": "completed", "tag": "8e4b1127-3db2-4f93-a731-315192c060b3"}, {"server_uuid": "c7fa09fb-ae2b-4479-8848-f142131fe33a", "name": "network-vif-plugged", "status": "completed", "tag": "d9ecab87-157e-4ccb-8423-2248bb8451ea"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:31:45.341558 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-823c9083-75ed-4fa8-9b17-9f858f161f7d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:45.344368 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-823c9083-75ed-4fa8-9b17-9f858f161f7d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:45.346250 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-823c9083-75ed-4fa8-9b17-9f858f161f7d admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/2a8b8278-3a88-450a-a98b-f56b0eeba810 HTTP/1.1" status: 204 len: 168 time: 0.2165148 Dec 08 11:31:45.364333 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-823c9083-75ed-4fa8-9b17-9f858f161f7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a8b8278-3a88-450a-a98b-f56b0eeba810,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:45.463659 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00a21927-d2aa-4a9a-baf2-7194eb5691cf req-fc9d2dbf-f40e-43cc-8d63-a1725aabd2e8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:45.465399 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-00a21927-d2aa-4a9a-baf2-7194eb5691cf req-fc9d2dbf-f40e-43cc-8d63-a1725aabd2e8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0968218 Dec 08 11:31:45.500487 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-563ec64d-6185-48ad-88bc-d897c5a4dde9 req-7ce2904a-6430-494d-8e4e-cd180e105bf8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:45.502079 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-563ec64d-6185-48ad-88bc-d897c5a4dde9 req-7ce2904a-6430-494d-8e4e-cd180e105bf8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 946 time: 0.0926065 Dec 08 11:31:45.516205 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3fb0f36e-fc2a-47e5-9a6d-6f40cbf1649c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:45.518987 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3fb0f36e-fc2a-47e5-9a6d-6f40cbf1649c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:45.529182 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-3fb0f36e-fc2a-47e5-9a6d-6f40cbf1649c admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/7a21861d-2395-4936-ba16-957181b181a8 HTTP/1.1" status: 204 len: 168 time: 0.2919250 Dec 08 11:31:45.554478 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fb0f36e-fc2a-47e5-9a6d-6f40cbf1649c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7a21861d-2395-4936-ba16-957181b181a8,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:45.602742 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-00a21927-d2aa-4a9a-baf2-7194eb5691cf req-cd720ac4-74b7-4335-98de-0e65f8779091 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1304390 Dec 08 11:31:45.625074 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-563ec64d-6185-48ad-88bc-d897c5a4dde9 req-a2c49518-5b63-46b0-8a21-fce0f4cb01d1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1056161 Dec 08 11:31:45.672303 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 354 Content-Type: application/json Date: Wed, 08 Dec 2021 11:31:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34cdcec5-0cfc-4b9e-addd-f76e600232ae x-openstack-request-id: req-34cdcec5-0cfc-4b9e-addd-f76e600232ae {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:31:45.672798 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fe445662-9a2d-4c17-96ea-b054be927e53", "name": "network-vif-plugged", "status": "completed", "tag": "8e4b1127-3db2-4f93-a731-315192c060b3", "code": 200}, {"server_uuid": "c7fa09fb-ae2b-4479-8848-f142131fe33a", "name": "network-vif-plugged", "status": "completed", "tag": "d9ecab87-157e-4ccb-8423-2248bb8451ea", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:31:45.672961 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-34cdcec5-0cfc-4b9e-addd-f76e600232ae {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:31:45.673458 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fe445662-9a2d-4c17-96ea-b054be927e53', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8e4b1127-3db2-4f93-a731-315192c060b3', 'code': 200} Dec 08 11:31:45.673772 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7fa09fb-ae2b-4479-8848-f142131fe33a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9ecab87-157e-4ccb-8423-2248bb8451ea', 'code': 200} Dec 08 11:31:45.873814 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d16f269-ed85-49c2-aab0-0735296eab71 req-a14d49c9-4110-43b6-9e8f-0c36d62a64e7 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:45.885708 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7d16f269-ed85-49c2-aab0-0735296eab71 req-a14d49c9-4110-43b6-9e8f-0c36d62a64e7 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 945 time: 0.0987728 Dec 08 11:31:46.011301 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7d16f269-ed85-49c2-aab0-0735296eab71 req-bd501622-de4f-46f0-81cb-2b9577d82b5a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1231349 Dec 08 11:31:46.047300 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ba3d4f-4003-41ae-a83e-8c8cca5581eb req-f81e8d7a-6442-4c2a-81b4-789890f9f51f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:46.049238 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-68ba3d4f-4003-41ae-a83e-8c8cca5581eb req-f81e8d7a-6442-4c2a-81b4-789890f9f51f service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 1099 time: 0.1469076 Dec 08 11:31:46.052859 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 50332) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:46.087400 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c24af5-fb9a-4c24-bf9e-bd305d87a57f req-c8e8b4ca-8dab-4e4d-8b5d-5ef9779237e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:46.090489 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e9b7f188-71b0-4fec-8d78-43b36891907f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:46.093084 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-41c24af5-fb9a-4c24-bf9e-bd305d87a57f req-c8e8b4ca-8dab-4e4d-8b5d-5ef9779237e4 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 1098 time: 0.1193666 Dec 08 11:31:46.138408 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d454550-f6c9-4745-bf56-e3f9560397fa req-04e6ecd7-9dde-44e8-85b2-8b95c1c7a59e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:46.146210 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9d454550-f6c9-4745-bf56-e3f9560397fa req-04e6ecd7-9dde-44e8-85b2-8b95c1c7a59e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 945 time: 0.1653705 Dec 08 11:31:46.156028 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-41c24af5-fb9a-4c24-bf9e-bd305d87a57f req-75d78461-43aa-4c01-b524-64042d725564 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557082 Dec 08 11:31:46.183530 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-68ba3d4f-4003-41ae-a83e-8c8cca5581eb req-4fb5900c-7753-4c6d-8332-39d7dab37353 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1135876 Dec 08 11:31:46.208447 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:31:46.228166 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9d454550-f6c9-4745-bf56-e3f9560397fa req-c81021b6-38e2-4dab-8bc5-3503a442a26e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0810223 Dec 08 11:31:46.283389 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e9b7f188-71b0-4fec-8d78-43b36891907f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:46.286114 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:31:46.289401 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e9b7f188-71b0-4fec-8d78-43b36891907f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:46.294340 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:31:46.295080 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:46.334009 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-e9b7f188-71b0-4fec-8d78-43b36891907f admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=0f1a51eea5a945299f1e94a6934789d0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2759695 Dec 08 11:31:46.334530 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 50342) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:46.342190 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9b7f188-71b0-4fec-8d78-43b36891907f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6401546b-08e2-4950-a8b0-2f444d2448f6,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:46.397035 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:46.416424 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-84f8a345-dd51-4065-8d52-97cc68903a7d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:46.431197 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:31:46.436773 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:46.446793 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-84f8a345-dd51-4065-8d52-97cc68903a7d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:46.492215 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:46.528996 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-84f8a345-dd51-4065-8d52-97cc68903a7d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:46.532174 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-84f8a345-dd51-4065-8d52-97cc68903a7d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:46.535767 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-84f8a345-dd51-4065-8d52-97cc68903a7d admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/6401546b-08e2-4950-a8b0-2f444d2448f6 HTTP/1.1" status: 204 len: 168 time: 0.1981320 Dec 08 11:31:46.541665 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84f8a345-dd51-4065-8d52-97cc68903a7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6401546b-08e2-4950-a8b0-2f444d2448f6,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:46.817712 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01f5a644-7e84-4bab-b40c-5927ef4b7f40 req-3ccc7b99-d9ac-4821-971c-b5b037c05ea4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:46.819298 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-01f5a644-7e84-4bab-b40c-5927ef4b7f40 req-3ccc7b99-d9ac-4821-971c-b5b037c05ea4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 946 time: 0.1091330 Dec 08 11:31:46.833378 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aaaf1f5-e3ee-4315-93ec-c7aeb78a85de req-0c982951-0eb2-4770-b35d-5ebc33e78a61 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:46.835327 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2aaaf1f5-e3ee-4315-93ec-c7aeb78a85de req-0c982951-0eb2-4770-b35d-5ebc33e78a61 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0716639 Dec 08 11:31:46.908813 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-01f5a644-7e84-4bab-b40c-5927ef4b7f40 req-62a9e31d-3339-4d44-9cbd-442d976a08ce tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0834229 Dec 08 11:31:46.931064 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2aaaf1f5-e3ee-4315-93ec-c7aeb78a85de req-b597a766-2015-48b2-8ed0-f94b98d5ad3b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0762756 Dec 08 11:31:47.004806 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50382) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:47.044093 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50388) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:47.118625 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce5192f-fcb6-488f-84c1-3decfe2d3b48 req-bc7fa1db-b895-491e-a671-f6b0c52ce9d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:47.119876 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7ce5192f-fcb6-488f-84c1-3decfe2d3b48 req-bc7fa1db-b895-491e-a671-f6b0c52ce9d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0834472 Dec 08 11:31:47.129842 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50396) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:47.135726 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-53fe47b3-9601-4729-b580-4fc91072d92a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Request body: {'floatingip': {'port_id': '731fa8a4-e27d-4561-a86e-aa21c87548e7'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:47.160528 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e9a2176-b3ff-4d81-94cb-fb35044f66d5 req-c694f86b-0ad2-48fa-8449-2f67ffdc9b16 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:47.163493 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5e9a2176-b3ff-4d81-94cb-fb35044f66d5 req-c694f86b-0ad2-48fa-8449-2f67ffdc9b16 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 945 time: 0.0636165 Dec 08 11:31:47.227030 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5e9a2176-b3ff-4d81-94cb-fb35044f66d5 req-150ce4d5-d7d1-4026-9c8f-612f070e353b tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559618 Dec 08 11:31:47.239937 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-53fe47b3-9601-4729-b580-4fc91072d92a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:47.298186 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f2d063b4-67e3-4626-b763-e7c0c3c4674e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:47.335252 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1510293599-network', 'tenant_id': 'bde1d456ccb0411eaed7cb4c5c07de7d'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:47.357661 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6385ff62-b0e6-445b-ab15-e5b10c274522 req-3566889a-72cb-48a1-938f-30b9cff58514 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:47.359177 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6385ff62-b0e6-445b-ab15-e5b10c274522 req-3566889a-72cb-48a1-938f-30b9cff58514 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0586112 Dec 08 11:31:47.422083 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6385ff62-b0e6-445b-ab15-e5b10c274522 req-b7179592-e64f-4c21-9c14-823a71c91e7e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0524735 Dec 08 11:31:47.429915 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Made reservation on behalf of bde1d456ccb0411eaed7cb4c5c07de7d for: {'network': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:47.432021 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:47.456771 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:47.534916 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:47.673047 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f2d063b4-67e3-4626-b763-e7c0c3c4674e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:47.675458 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:31:47.680231 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-97b9d02b-2af0-4206-9d3d-d8be961eddb3" -d '{"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-plugged", "status": "completed", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:31:47.715860 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f2d063b4-67e3-4626-b763-e7c0c3c4674e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:47.731490 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:31:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9a6bcd3c-3d68-4ea6-9d9c-fa252a7c1efe x-openstack-request-id: req-9a6bcd3c-3d68-4ea6-9d9c-fa252a7c1efe {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:31:47.731810 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-plugged", "status": "completed", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:31:47.732070 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-9a6bcd3c-3d68-4ea6-9d9c-fa252a7c1efe {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:31:47.732463 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'code': 200} Dec 08 11:31:47.904794 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-f2d063b4-67e3-4626-b763-e7c0c3c4674e admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=ca271e7ac6af42c7901314c37f6b88e2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8592367 Dec 08 11:31:47.907517 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 50416) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:47.918955 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d063b4-67e3-4626-b763-e7c0c3c4674e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be96a61c-e277-4f7d-b848-3f6ed050902b,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:47.929819 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:47.950632 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:48.025390 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a1c27c99-a3c6-4f4b-a6e5-ed501dc50170 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:48.070566 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-163cde2c-922d-45d3-b835-5d5ca6182505 req-d8e72383-47f5-4ae5-8a10-316e20caca5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:48.072049 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-163cde2c-922d-45d3-b835-5d5ca6182505 req-d8e72383-47f5-4ae5-8a10-316e20caca5f service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 1099 time: 0.1243422 Dec 08 11:31:48.096680 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a1c27c99-a3c6-4f4b-a6e5-ed501dc50170 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:48.248785 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] vlan segment allocate from pool success with {'vlan_id': 291, 'physical_network': 'physnet1'} {{(pid=102317) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:31:48.274392 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87031582-9f52-42b8-944f-dbb7215da8ae,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:48.289094 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:48.289457 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.segments_db [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Added segment c37df7a5-94f5-4cf8-8161-23e912b124b9 of type vlan for network 1056c468-8569-46d3-ae01-3e9a87553272 Dec 08 11:31:48.377743 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4d23ffc-873a-473f-a20b-99094ddf92d1 req-60df039c-aead-4497-a459-2af4c0e99a8a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:48.377743 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4d23ffc-873a-473f-a20b-99094ddf92d1 req-60df039c-aead-4497-a459-2af4c0e99a8a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 946 time: 0.3701024 Dec 08 11:31:48.394230 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:48.432175 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-163cde2c-922d-45d3-b835-5d5ca6182505 req-3070b176-2cdb-43ec-9096-d6e39cd272df service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3378007 Dec 08 11:31:48.456297 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25043bd9-594f-4e59-828f-9008168f5fc5 req-d0600012-2265-4e8c-b6bc-84c4e4f7f025 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:48.457802 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-25043bd9-594f-4e59-828f-9008168f5fc5 req-d0600012-2265-4e8c-b6bc-84c4e4f7f025 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 945 time: 0.1309466 Dec 08 11:31:48.463397 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a1c27c99-a3c6-4f4b-a6e5-ed501dc50170 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:48.465964 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a1c27c99-a3c6-4f4b-a6e5-ed501dc50170 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:48.467059 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-a1c27c99-a3c6-4f4b-a6e5-ed501dc50170 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/be96a61c-e277-4f7d-b848-3f6ed050902b HTTP/1.1" status: 204 len: 168 time: 0.5583823 Dec 08 11:31:48.488300 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4d23ffc-873a-473f-a20b-99094ddf92d1 req-c25bdf20-e27f-4da9-a8c1-c2a52ba48dda tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0998569 Dec 08 11:31:48.494907 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1c27c99-a3c6-4f4b-a6e5-ed501dc50170 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be96a61c-e277-4f7d-b848-3f6ed050902b,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:48.496628 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-53fe47b3-9601-4729-b580-4fc91072d92a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:48.501308 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:48.502262 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:48.502942 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:48.517538 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-53fe47b3-9601-4729-b580-4fc91072d92a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:48.533821 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-25043bd9-594f-4e59-828f-9008168f5fc5 req-e6f28ef2-60ea-42c8-8c0e-0ca03e6f96c7 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617480 Dec 08 11:31:48.586439 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 50432) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:48.592780 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-06edf567-0a70-4882-9d79-738e3f04aca7 admin admin] Request body: {'subnet': {'network_id': '1056c468-8569-46d3-ae01-3e9a87553272', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1510293599-subnet', 'tenant_id': 'bde1d456ccb0411eaed7cb4c5c07de7d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:48.593362 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.5802505 Dec 08 11:31:48.651103 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-06edf567-0a70-4882-9d79-738e3f04aca7 admin admin] Made reservation on behalf of bde1d456ccb0411eaed7cb4c5c07de7d for: {'subnet': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:31:48.653861 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-06edf567-0a70-4882-9d79-738e3f04aca7 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:48.686558 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de4cb665-bd8c-4054-baaa-ad6e3786ced4 admin admin] Pushing event updated for resources: {'Network': ['ID=1056c468-8569-46d3-ae01-3e9a87553272,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:48.698062 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network 1056c468-8569-46d3-ae01-3e9a87553272 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:31:48.715282 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c1b829-7383-41fb-aefe-0c458d94b01b req-3060436c-2f64-472c-8c18-b746d8f3637b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:48.717002 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-08c1b829-7383-41fb-aefe-0c458d94b01b req-3060436c-2f64-472c-8c18-b746d8f3637b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.1204348 Dec 08 11:31:48.733011 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.l3_db [None req-53fe47b3-9601-4729-b580-4fc91072d92a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Floating IP fd0a7f40-f924-4e9c-bc63-9482b537d307 associated. External IP: 172.27.2.124, port: 731fa8a4-e27d-4561-a86e-aa21c87548e7. Dec 08 11:31:48.816258 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-08c1b829-7383-41fb-aefe-0c458d94b01b req-174a9b41-ce08-489a-b17a-c5241632c691 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0863504 Dec 08 11:31:48.942949 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-06edf567-0a70-4882-9d79-738e3f04aca7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for subnet, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:49.009256 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 50442) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:49.034493 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06edf567-0a70-4882-9d79-738e3f04aca7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a2e78872-9414-489f-b73b-b06f4460aa93,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:49.036321 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d2195667-a15b-4b2a-a3dc-c40227020793 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:49.071900 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-06edf567-0a70-4882-9d79-738e3f04aca7 admin admin] Checking segment: {'id': 'c37df7a5-94f5-4cf8-8161-23e912b124b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '1056c468-8569-46d3-ae01-3e9a87553272'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:31:49.072288 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06edf567-0a70-4882-9d79-738e3f04aca7 admin admin] Network hostable DHCP agents. Network: 1056c468-8569-46d3-ae01-3e9a87553272, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102318) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:31:49.085648 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-53fe47b3-9601-4729-b580-4fc91072d92a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Router e1280faa-8f3b-40a4-8270-5461288df246 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:31:49.105899 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06edf567-0a70-4882-9d79-738e3f04aca7 admin admin] Network 1056c468-8569-46d3-ae01-3e9a87553272 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102318) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:31:49.123402 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-06edf567-0a70-4882-9d79-738e3f04aca7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, 1056c468-8569-46d3-ae01-3e9a87553272) {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:31:49.133295 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06edf567-0a70-4882-9d79-738e3f04aca7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:49.133295 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-06edf567-0a70-4882-9d79-738e3f04aca7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:49.146226 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66bcfd5d-5900-4a12-b55d-c5b9bbb41f1e None None] Network 1056c468-8569-46d3-ae01-3e9a87553272 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:31:49.173235 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-06edf567-0a70-4882-9d79-738e3f04aca7 admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.5769868 Dec 08 11:31:49.173235 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d2195667-a15b-4b2a-a3dc-c40227020793 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:49.181508 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d2195667-a15b-4b2a-a3dc-c40227020793 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:49.229750 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-d2195667-a15b-4b2a-a3dc-c40227020793 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=70d5aa88429b424bbb321a7fcc778140&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2194653 Dec 08 11:31:49.231689 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2195667-a15b-4b2a-a3dc-c40227020793 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=01a523e4-a692-41ca-ba8c-58a1c9e3eda8,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:49.233999 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 50450) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:49.264814 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53fe47b3-9601-4729-b580-4fc91072d92a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:31:49.291790 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29ef09c6-3ea5-494c-ae81-2c02cb49fac8 None None] Sync routers for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:31:49.294250 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-53fe47b3-9601-4729-b580-4fc91072d92a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:49.294515 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6801662b-8649-40f6-9495-2e3cc32d3cf7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:49.312940 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29ef09c6-3ea5-494c-ae81-2c02cb49fac8 None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:31:49.316884 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-29ef09c6-3ea5-494c-ae81-2c02cb49fac8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:31:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:49.325498 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6801662b-8649-40f6-9495-2e3cc32d3cf7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:49.342309 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-53fe47b3-9601-4729-b580-4fc91072d92a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "PUT /v2.0/floatingips/fd0a7f40-f924-4e9c-bc63-9482b537d307 HTTP/1.1" status: 200 len: 991 time: 2.2111797 Dec 08 11:31:49.343454 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538', 'tag': '731fa8a4-e27d-4561-a86e-aa21c87548e7'}] {{(pid=102317) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:31:49.346566 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}212dae370a2b559de5b7d578af79073c1e0f4cb02126db35c6693ef88f95633e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-87171883-e66a-4fb0-9839-04e7f948c1a5" -d '{"events": [{"name": "network-changed", "server_uuid": "6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538", "tag": "731fa8a4-e27d-4561-a86e-aa21c87548e7"}]}' {{(pid=102317) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:31:49.411048 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32ddf625-b2d4-4166-9a97-721561c264da None None] Network 1056c468-8569-46d3-ae01-3e9a87553272 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:31:49.411952 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6801662b-8649-40f6-9495-2e3cc32d3cf7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:49.417213 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6801662b-8649-40f6-9495-2e3cc32d3cf7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:49.429730 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-6801662b-8649-40f6-9495-2e3cc32d3cf7 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/01a523e4-a692-41ca-ba8c-58a1c9e3eda8 HTTP/1.1" status: 204 len: 168 time: 0.1946344 Dec 08 11:31:49.444038 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6801662b-8649-40f6-9495-2e3cc32d3cf7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=01a523e4-a692-41ca-ba8c-58a1c9e3eda8,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:49.472709 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:31:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-baa46b30-6ef7-40e0-8162-852d4eebcd46 x-openstack-request-id: req-baa46b30-6ef7-40e0-8162-852d4eebcd46 {{(pid=102317) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:31:49.473490 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538", "tag": "731fa8a4-e27d-4561-a86e-aa21c87548e7", "status": "completed", "code": 200}]} {{(pid=102317) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:31:49.473903 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-baa46b30-6ef7-40e0-8162-852d4eebcd46 {{(pid=102317) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:31:49.474512 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538', 'tag': '731fa8a4-e27d-4561-a86e-aa21c87548e7', 'status': 'completed', 'code': 200} Dec 08 11:31:49.528919 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-29ef09c6-3ea5-494c-ae81-2c02cb49fac8 None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:31:49.603082 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-b1e18056-89c4-446a-8573-93fcb7fefa40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:49.609556 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-b1e18056-89c4-446a-8573-93fcb7fefa40 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=9c60094b48d34489b46e92ae73d7e33a&device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 1098 time: 0.1146767 Dec 08 11:31:49.794973 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d45f1f04-b7b3-46a4-8a93-b328d5724dcc req-9faa0a58-42f2-4f60-a17b-a856798d7dae tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:49.796730 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d45f1f04-b7b3-46a4-8a93-b328d5724dcc req-9faa0a58-42f2-4f60-a17b-a856798d7dae tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 946 time: 0.1446664 Dec 08 11:31:49.830742 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-28b45939-1a59-47ca-9eb8-67b171778852 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:49.832384 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-28b45939-1a59-47ca-9eb8-67b171778852 service neutron] 10.222.0.61 "GET /v2.0/networks?id=185aeb08-41ef-4fae-a420-33296f710850 HTTP/1.1" status: 200 len: 911 time: 0.2190073 Dec 08 11:31:49.979077 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-29ef09c6-3ea5-494c-ae81-2c02cb49fac8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'fd0a7f40-f924-4e9c-bc63-9482b537d307', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'floating_ip_address': '172.27.2.124', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'port_id': '731fa8a4-e27d-4561-a86e-aa21c87548e7', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 114, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'mac_address': 'fa:16:3e:76:9b:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:31:21Z', 'updated_at': '2021-12-08T11:31:48Z', 'revision_number': 1, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:20Z', 'revision_number': 5, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:49.997433 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-88776791-4c18-4173-ad98-3d6c08d488d6 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=731fa8a4-e27d-4561-a86e-aa21c87548e7 HTTP/1.1" status: 200 len: 999 time: 0.1532381 Dec 08 11:31:50.066290 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29ef09c6-3ea5-494c-ae81-2c02cb49fac8 None None] Checking router: e1280faa-8f3b-40a4-8270-5461288df246 for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:31:50.088865 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d45f1f04-b7b3-46a4-8a93-b328d5724dcc req-835659f3-f9b3-4cd7-8f01-72ffff60afbd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2824190 Dec 08 11:31:50.118746 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b3fc320-5754-48cb-ba02-153988d5f52c req-f24afabc-660c-4101-81a9-02120b504991 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:50.126465 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29ef09c6-3ea5-494c-ae81-2c02cb49fac8 None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:31:50.127282 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-29ef09c6-3ea5-494c-ae81-2c02cb49fac8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:31:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:50.138734 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5b3fc320-5754-48cb-ba02-153988d5f52c req-f24afabc-660c-4101-81a9-02120b504991 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.1400476 Dec 08 11:31:50.163667 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-35064325-abf1-40c0-bf02-9ecc1754312b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:50.165439 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-35064325-abf1-40c0-bf02-9ecc1754312b service neutron] 10.222.0.61 "GET /v2.0/subnets?id=40a584f7-ce77-4d89-87c2-4f3f589c6700 HTTP/1.1" status: 200 len: 849 time: 0.1486385 Dec 08 11:31:50.236799 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5b3fc320-5754-48cb-ba02-153988d5f52c req-33302516-c00a-4392-9ab3-cc7c47488a25 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0892143 Dec 08 11:31:50.251444 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-e3c6d54a-4cb8-44d2-b17a-a389e1f37893 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:50.253274 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-e3c6d54a-4cb8-44d2-b17a-a389e1f37893 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=185aeb08-41ef-4fae-a420-33296f710850&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0786226 Dec 08 11:31:50.370038 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-29ef09c6-3ea5-494c-ae81-2c02cb49fac8 None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:31:50.370583 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-c0b25a4c-9d09-4996-ad50-671e7fdbc316 service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1078007 Dec 08 11:31:50.501611 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-87171883-e66a-4fb0-9839-04e7f948c1a5 req-3a09cb68-93e8-4112-a82d-313c2fc11755 service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1234450 Dec 08 11:31:50.636879 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-29ef09c6-3ea5-494c-ae81-2c02cb49fac8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'fd0a7f40-f924-4e9c-bc63-9482b537d307', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'floating_ip_address': '172.27.2.124', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'port_id': '731fa8a4-e27d-4561-a86e-aa21c87548e7', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 114, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'mac_address': 'fa:16:3e:76:9b:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:31:21Z', 'updated_at': '2021-12-08T11:31:48Z', 'revision_number': 1, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:20Z', 'revision_number': 5, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:50.749941 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-29ef09c6-3ea5-494c-ae81-2c02cb49fac8 None None] The sync data for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi is: [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'fd0a7f40-f924-4e9c-bc63-9482b537d307', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'floating_ip_address': '172.27.2.124', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'port_id': '731fa8a4-e27d-4561-a86e-aa21c87548e7', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 114, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'mac_address': 'fa:16:3e:76:9b:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:31:21Z', 'updated_at': '2021-12-08T11:31:48Z', 'revision_number': 1, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:20Z', 'revision_number': 5, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:31:51.000404 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64076727-faa8-4586-bdf3-9eb97094bb80 None None] New status for floating IP fd0a7f40-f924-4e9c-bc63-9482b537d307: ACTIVE {{(pid=102319) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:31:51.349091 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a1204f-4128-4a75-a46d-f7b4088bc6dd req-e1b106e4-e3ad-40d6-b343-14c9951714ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:51.350677 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-91a1204f-4128-4a75-a46d-f7b4088bc6dd req-e1b106e4-e3ad-40d6-b343-14c9951714ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0497801 Dec 08 11:31:51.401430 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-91a1204f-4128-4a75-a46d-f7b4088bc6dd req-7b25e7c6-2fd9-443d-8972-a73ed18f7267 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448046 Dec 08 11:31:51.529456 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12933a08-f722-44ae-aa16-2f89615b7cde req-c046ac41-a050-4fe0-9140-17aeecefc651 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:51.531041 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-12933a08-f722-44ae-aa16-2f89615b7cde req-c046ac41-a050-4fe0-9140-17aeecefc651 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0518842 Dec 08 11:31:51.540345 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 50556) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:51.544807 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-843804c4-e601-4368-8e30-875d2018dc15 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Request body: {'floatingip': {'port_id': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:31:51.618464 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-843804c4-e601-4368-8e30-875d2018dc15 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:51.714877 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50564) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:51.816430 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-928308df-7075-43c7-99d7-10d976d27c70 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:51.891445 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-928308df-7075-43c7-99d7-10d976d27c70 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:51.896408 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-928308df-7075-43c7-99d7-10d976d27c70 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:51.938880 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-928308df-7075-43c7-99d7-10d976d27c70 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=e1f27e293b84474b885368a9e5022644&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2228310 Dec 08 11:31:51.940758 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-928308df-7075-43c7-99d7-10d976d27c70 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df4f14af-d9b5-43d2-b192-b588d5ee0896,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:51.943030 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50570) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:51.990765 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-3be03374-8406-4fb9-adc0-7a97e34f94c7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.011038 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-3be03374-8406-4fb9-adc0-7a97e34f94c7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.058924 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-3be03374-8406-4fb9-adc0-7a97e34f94c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.061844 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-3be03374-8406-4fb9-adc0-7a97e34f94c7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.062989 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-3be03374-8406-4fb9-adc0-7a97e34f94c7 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/df4f14af-d9b5-43d2-b192-b588d5ee0896 HTTP/1.1" status: 204 len: 168 time: 0.1190581 Dec 08 11:31:52.070705 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3be03374-8406-4fb9-adc0-7a97e34f94c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df4f14af-d9b5-43d2-b192-b588d5ee0896,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:52.361313 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50582) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:52.374596 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ed962fd6-022c-4b97-9b52-20fa915d060b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.392279 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.db.resource_extend [None req-843804c4-e601-4368-8e30-875d2018dc15 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] It took 0.28 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 08 11:31:52.447711 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ed962fd6-022c-4b97-9b52-20fa915d060b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.452958 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2d0ef2a8-97ad-4ae8-ae23-fcf61191826e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.454723 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ed962fd6-022c-4b97-9b52-20fa915d060b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.475642 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-843804c4-e601-4368-8e30-875d2018dc15 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.479433 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-843804c4-e601-4368-8e30-875d2018dc15 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.493058 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-ed962fd6-022c-4b97-9b52-20fa915d060b admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=9c99be9d92974ecfb4e561afbe2ddd8c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1306305 Dec 08 11:31:52.495004 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed962fd6-022c-4b97-9b52-20fa915d060b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f758082b-72f6-4c5d-b7b7-c3dbfd65eb1f,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:52.497256 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50584) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:52.547045 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1e1510d5-ce5f-42ad-912e-ca230a4adea6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.567655 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1e1510d5-ce5f-42ad-912e-ca230a4adea6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.576402 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [None req-843804c4-e601-4368-8e30-875d2018dc15 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Floating IP 07f6101c-247e-4ed1-a7fa-bfb3e71fdaa3 associated. External IP: 172.27.2.95, port: 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe. Dec 08 11:31:52.618678 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1e1510d5-ce5f-42ad-912e-ca230a4adea6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.621295 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1e1510d5-ce5f-42ad-912e-ca230a4adea6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.622657 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-1e1510d5-ce5f-42ad-912e-ca230a4adea6 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/f758082b-72f6-4c5d-b7b7-c3dbfd65eb1f HTTP/1.1" status: 204 len: 168 time: 0.1244512 Dec 08 11:31:52.632558 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e1510d5-ce5f-42ad-912e-ca230a4adea6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f758082b-72f6-4c5d-b7b7-c3dbfd65eb1f,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:52.799977 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-843804c4-e601-4368-8e30-875d2018dc15 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:31:52.910249 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-843804c4-e601-4368-8e30-875d2018dc15 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:31:52.915228 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-843804c4-e601-4368-8e30-875d2018dc15 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:52.921617 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0349cb5f-be34-483f-ae38-e10761c3bd93 None None] Sync routers for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:31:52.932617 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0349cb5f-be34-483f-ae38-e10761c3bd93 None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:31:52.933290 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-0349cb5f-be34-483f-ae38-e10761c3bd93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:31:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:52.944907 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-843804c4-e601-4368-8e30-875d2018dc15 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "PUT /v2.0/floatingips/07f6101c-247e-4ed1-a7fa-bfb3e71fdaa3 HTTP/1.1" status: 200 len: 991 time: 1.4035177 Dec 08 11:31:52.945721 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:31:52.948286 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20c83378-43aa-4264-be4d-571bc1894ba5" -d '{"events": [{"name": "network-changed", "server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:31:53.047068 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-0349cb5f-be34-483f-ae38-e10761c3bd93 None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:31:53.303803 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-0349cb5f-be34-483f-ae38-e10761c3bd93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': '07f6101c-247e-4ed1-a7fa-bfb3e71fdaa3', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'floating_ip_address': '172.27.2.95', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'port_id': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 139, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'mac_address': 'fa:16:3e:f5:f7:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:31:31Z', 'updated_at': '2021-12-08T11:31:52Z', 'revision_number': 1, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:27Z', 'revision_number': 5, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:53.332429 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0349cb5f-be34-483f-ae38-e10761c3bd93 None None] Checking router: d1e1bffc-ba94-4ef3-b10a-203d4ed7519f for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:31:53.341133 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0349cb5f-be34-483f-ae38-e10761c3bd93 None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:31:53.341766 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-0349cb5f-be34-483f-ae38-e10761c3bd93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:31:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:53.445387 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-0349cb5f-be34-483f-ae38-e10761c3bd93 None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:31:53.665112 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-0349cb5f-be34-483f-ae38-e10761c3bd93 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': '07f6101c-247e-4ed1-a7fa-bfb3e71fdaa3', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'floating_ip_address': '172.27.2.95', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'port_id': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 139, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'mac_address': 'fa:16:3e:f5:f7:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:31:31Z', 'updated_at': '2021-12-08T11:31:52Z', 'revision_number': 1, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:27Z', 'revision_number': 5, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:31:53.694641 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0349cb5f-be34-483f-ae38-e10761c3bd93 None None] The sync data for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi is: [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': '07f6101c-247e-4ed1-a7fa-bfb3e71fdaa3', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'floating_ip_address': '172.27.2.95', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'port_id': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 139, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'mac_address': 'fa:16:3e:f5:f7:79', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:31:31Z', 'updated_at': '2021-12-08T11:31:52Z', 'revision_number': 1, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:27Z', 'revision_number': 5, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:31:53.713543 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50632) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:53.822553 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-710e73a8-8850-4f49-8187-6e86d49b5372 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:53.896137 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1bbb6712-c065-4a72-9a45-bcd2645a4028 None None] New status for floating IP 07f6101c-247e-4ed1-a7fa-bfb3e71fdaa3: ACTIVE {{(pid=102319) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:31:53.899328 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-710e73a8-8850-4f49-8187-6e86d49b5372 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:53.903418 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-710e73a8-8850-4f49-8187-6e86d49b5372 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:53.941667 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-710e73a8-8850-4f49-8187-6e86d49b5372 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=be2306f3dfa248559583409091783c72&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2264042 Dec 08 11:31:53.942416 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-710e73a8-8850-4f49-8187-6e86d49b5372 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e68af689-afe3-43c9-b731-661817ba7dad,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:53.944859 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 50636) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:31:53.993899 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b21bcff6-8415-45be-b786-2e87fea20a3a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:54.015206 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b21bcff6-8415-45be-b786-2e87fea20a3a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:54.062885 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b21bcff6-8415-45be-b786-2e87fea20a3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:54.065475 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b21bcff6-8415-45be-b786-2e87fea20a3a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:54.066681 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-b21bcff6-8415-45be-b786-2e87fea20a3a admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/e68af689-afe3-43c9-b731-661817ba7dad HTTP/1.1" status: 204 len: 168 time: 0.1207182 Dec 08 11:31:54.075516 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b21bcff6-8415-45be-b786-2e87fea20a3a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e68af689-afe3-43c9-b731-661817ba7dad,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:31:54.680890 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-5ca2561a-a8c0-462c-bf54-6af316be0c55 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:55.755983 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:56.280020 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:31:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b395e8c7-53d1-47ff-8e42-694b9c3644de x-openstack-request-id: req-b395e8c7-53d1-47ff-8e42-694b9c3644de {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:31:56.280450 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:31:56.280555 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-b395e8c7-53d1-47ff-8e42-694b9c3644de {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:31:56.280970 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'status': 'completed', 'code': 200} Dec 08 11:31:56.659595 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-8285f7e4-48b7-4dca-a60e-5c6c587d2f6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:56.661004 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-8285f7e4-48b7-4dca-a60e-5c6c587d2f6f service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 1099 time: 0.0408211 Dec 08 11:31:56.765694 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-6f44ccb3-69ac-4b78-9f62-1226f1b34f92 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:56.769708 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-6f44ccb3-69ac-4b78-9f62-1226f1b34f92 service neutron] 10.222.0.61 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 917 time: 0.0939965 Dec 08 11:31:56.837700 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-b5bef028-88ab-42c2-80ac-1ed3bd977ea9 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe HTTP/1.1" status: 200 len: 1001 time: 0.0620470 Dec 08 11:31:56.893394 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-3dbb2883-13cb-4e41-9cc2-d0d87a488a37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:56.895843 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-3dbb2883-13cb-4e41-9cc2-d0d87a488a37 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 200 len: 855 time: 0.0483735 Dec 08 11:31:56.953557 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-30474230-c7d6-44cf-bf62-0e77bb698ed4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:56.955058 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-30474230-c7d6-44cf-bf62-0e77bb698ed4 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=fd37a1fc-3614-462b-92a2-b41260c949a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0462732 Dec 08 11:31:57.047024 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-acf9c89b-dca4-4a75-8835-bd1a358db7d7 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845814 Dec 08 11:31:57.120752 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:57.152556 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20c83378-43aa-4264-be4d-571bc1894ba5 req-be91d984-a4b5-4489-b969-6b1df6d01f74 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0895524 Dec 08 11:31:57.752263 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-1a5f8acd-2ba3-45ec-b326-ea1d5e64715b tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:31:57.753650 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-1a5f8acd-2ba3-45ec-b326-ea1d5e64715b tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/networks?id=1056c468-8569-46d3-ae01-3e9a87553272 HTTP/1.1" status: 200 len: 809 time: 0.1033554 Dec 08 11:31:57.768177 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-8121a242-3283-4d38-9743-8576521922fd tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/quotas/bde1d456ccb0411eaed7cb4c5c07de7d HTTP/1.1" status: 200 len: 375 time: 0.0084519 Dec 08 11:31:57.801988 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-9eb0d767-3ee2-44ca-80df-e7f3cb2b6fa5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=bde1d456ccb0411eaed7cb4c5c07de7d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0277853 Dec 08 11:31:57.891502 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-ec096961-5146-4877-a23e-438e75a7c8b8 service neutron] 10.222.0.66 "GET /v2.0/networks/1056c468-8569-46d3-ae01-3e9a87553272?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822206 Dec 08 11:31:57.993967 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-0cdf1a24-a505-4cd8-b55e-b0393382aacb service neutron] 10.222.0.66 "GET /v2.0/networks/1056c468-8569-46d3-ae01-3e9a87553272?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0960567 Dec 08 11:31:58.173879 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:31:58.191379 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7a226ca7-977d-4d8e-91a5-fb4cdd569aca req-602e84ce-2c29-4ab6-b894-906251e2efcd tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 210 time: 0.0521078 Dec 08 11:32:03.780030 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-29890754-485c-42aa-a3bb-d4e9102f5bea req-cadc9706-a0f4-4f0c-880d-83220150bcdd tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 210 time: 0.0266442 Dec 08 11:32:04.550239 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-b2a770e4-6575-4072-9029-5a2638d54c6e tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:04.551695 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-b2a770e4-6575-4072-9029-5a2638d54c6e tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.61 "GET /v2.0/networks?id=1056c468-8569-46d3-ae01-3e9a87553272 HTTP/1.1" status: 200 len: 809 time: 0.1051469 Dec 08 11:32:04.568309 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Request body: {'port': {'device_id': 'd60041b9-3a0a-495a-aaa8-0da5f57e7e42', 'network_id': '1056c468-8569-46d3-ae01-3e9a87553272', 'admin_state_up': True, 'tenant_id': 'bde1d456ccb0411eaed7cb4c5c07de7d'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:04.673391 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Made reservation on behalf of bde1d456ccb0411eaed7cb4c5c07de7d for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:32:04.676800 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:04.804711 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Allocated IP 172.20.0.14 (1056c468-8569-46d3-ae01-3e9a87553272/a2e78872-9414-489f-b73b-b06f4460aa93/fdf2c7c1-363c-4a60-b59f-a320f77b0e66) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:32:04.911796 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fb632558-5427-457c-8245-2d2cf5afff91 req-152300cd-19eb-4f5b-a2b2-73eb87922736 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 210 time: 0.0613821 Dec 08 11:32:04.971008 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:05.003023 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:05.045199 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Network 1056c468-8569-46d3-ae01-3e9a87553272 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:05.050053 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:05.053823 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:32:05.059670 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:05.060289 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:05.066389 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Pushing event updated for resources: {'Port': ['ID=fdf2c7c1-363c-4a60-b59f-a320f77b0e66,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:05.078480 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:05.078641 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:05.078976 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:05.079312 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:05.079645 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:05.079973 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:05.080396 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:05.080723 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:05.081049 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:05.081402 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:05.081740 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:05.082047 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:05.082368 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:05.096768 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-40f3ab68-9f30-4612-a5db-bb2a159f676f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5322156 Dec 08 11:32:05.112323 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Request body: {'port': {'device_id': 'd60041b9-3a0a-495a-aaa8-0da5f57e7e42', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:05.175366 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:05.434361 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fdf2c7c1-363c-4a60-b59f-a320f77b0e66 {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:32:05.441594 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:05.453541 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Transition to ACTIVE for port object fdf2c7c1-363c-4a60-b59f-a320f77b0e66 will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:32:05.456996 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:05.507001 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Pushing event updated for resources: {'Port': ['ID=fdf2c7c1-363c-4a60-b59f-a320f77b0e66,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:05.533311 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Attempting to bind port fdf2c7c1-363c-4a60-b59f-a320f77b0e66 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:32:05.533638 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Attempting to bind port fdf2c7c1-363c-4a60-b59f-a320f77b0e66 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': 'c37df7a5-94f5-4cf8-8161-23e912b124b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '1056c468-8569-46d3-ae01-3e9a87553272'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:32:05.533969 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Attempting to bind port fdf2c7c1-363c-4a60-b59f-a320f77b0e66 on network 1056c468-8569-46d3-ae01-3e9a87553272 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:05.538744 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Port fdf2c7c1-363c-4a60-b59f-a320f77b0e66 on network 1056c468-8569-46d3-ae01-3e9a87553272 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:32:05.539061 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Attempting to bind port fdf2c7c1-363c-4a60-b59f-a320f77b0e66 on network 1056c468-8569-46d3-ae01-3e9a87553272 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:05.543705 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 31, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:32:05.544037 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Checking segment: {'id': 'c37df7a5-94f5-4cf8-8161-23e912b124b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '1056c468-8569-46d3-ae01-3e9a87553272'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:05.544405 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Bound using segment: {'id': 'c37df7a5-94f5-4cf8-8161-23e912b124b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '1056c468-8569-46d3-ae01-3e9a87553272'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:32:05.544827 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Bound port: fdf2c7c1-363c-4a60-b59f-a320f77b0e66, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c37df7a5-94f5-4cf8-8161-23e912b124b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '1056c468-8569-46d3-ae01-3e9a87553272'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:32:05.545190 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:05.607882 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] For port fdf2c7c1-363c-4a60-b59f-a320f77b0e66, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:32:05.611793 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] For port fdf2c7c1-363c-4a60-b59f-a320f77b0e66, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=fdf2c7c1-363c-4a60-b59f-a320f77b0e66,segment=NetworkSegment(c37df7a5-94f5-4cf8-8161-23e912b124b9),segment_id=c37df7a5-94f5-4cf8-8161-23e912b124b9)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:32:05.615275 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:05.649394 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:05.649642 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:05.651014 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] 10.222.0.61 "PUT /v2.0/ports/fdf2c7c1-363c-4a60-b59f-a320f77b0e66 HTTP/1.1" status: 200 len: 1094 time: 0.5429468 Dec 08 11:32:05.651451 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd60041b9-3a0a-495a-aaa8-0da5f57e7e42', 'tag': 'fdf2c7c1-363c-4a60-b59f-a320f77b0e66'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:32:05.653728 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877" -d '{"events": [{"name": "network-changed", "server_uuid": "d60041b9-3a0a-495a-aaa8-0da5f57e7e42", "tag": "fdf2c7c1-363c-4a60-b59f-a320f77b0e66"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:32:05.677440 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cac9ea71-7a8f-4908-bcea-7981912413ab service neutron] Pushing event updated for resources: {'Port': ['ID=fdf2c7c1-363c-4a60-b59f-a320f77b0e66,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:05.693254 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:32:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f2632e76-b375-41a5-866d-30131b3a5f8c x-openstack-request-id: req-f2632e76-b375-41a5-866d-30131b3a5f8c {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:32:05.694081 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d60041b9-3a0a-495a-aaa8-0da5f57e7e42", "tag": "fdf2c7c1-363c-4a60-b59f-a320f77b0e66", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:32:05.694334 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-f2632e76-b375-41a5-866d-30131b3a5f8c {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:32:05.694723 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd60041b9-3a0a-495a-aaa8-0da5f57e7e42', 'tag': 'fdf2c7c1-363c-4a60-b59f-a320f77b0e66', 'status': 'completed', 'code': 200} Dec 08 11:32:05.745796 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-019a5834-66e3-4930-94dc-698a20471625 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:05.747254 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-019a5834-66e3-4930-94dc-698a20471625 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=bde1d456ccb0411eaed7cb4c5c07de7d&device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 1097 time: 0.0398643 Dec 08 11:32:05.797787 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-9c5917a4-1da9-41d4-b04c-8953b0843464 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=fdf2c7c1-363c-4a60-b59f-a320f77b0e66 HTTP/1.1" status: 200 len: 217 time: 0.0376003 Dec 08 11:32:05.854219 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-a07ca175-4d40-4ec6-a03d-9b99911bccc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:05.855674 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-a07ca175-4d40-4ec6-a03d-9b99911bccc8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=a2e78872-9414-489f-b73b-b06f4460aa93 HTTP/1.1" status: 200 len: 849 time: 0.0456729 Dec 08 11:32:05.910954 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-8a4687ac-05f0-4d5d-a81d-73c107e3f9b0 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=1056c468-8569-46d3-ae01-3e9a87553272&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0264525 Dec 08 11:32:06.044597 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-7d5cced0-e241-4739-a33f-1f61a34f9090 service neutron] 10.222.0.61 "GET /v2.0/networks/1056c468-8569-46d3-ae01-3e9a87553272?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1203039 Dec 08 11:32:06.052721 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789c4027-7176-47c7-afc1-6593c1002931 req-4dfaca36-e00e-4c9e-82b9-49fa411dd56e tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:06.054124 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-789c4027-7176-47c7-afc1-6593c1002931 req-4dfaca36-e00e-4c9e-82b9-49fa411dd56e tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 944 time: 0.0722103 Dec 08 11:32:06.161966 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-789c4027-7176-47c7-afc1-6593c1002931 req-fec83e20-b50b-46a8-8938-98da4f783547 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0995045 Dec 08 11:32:06.177834 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd514bbf-ebf4-4fd9-8e77-69a393f8ccb5 req-a1510557-8ccc-4395-a106-36f9f5184b43 service neutron] 10.222.0.61 "GET /v2.0/networks/1056c468-8569-46d3-ae01-3e9a87553272?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1227231 Dec 08 11:32:06.272332 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-f0ac047c-d217-4fef-85b6-a1b3d9d931a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:06.273830 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-f0ac047c-d217-4fef-85b6-a1b3d9d931a8 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=bde1d456ccb0411eaed7cb4c5c07de7d&device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 1097 time: 0.0395973 Dec 08 11:32:06.369241 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-7ec1b475-b60d-4b50-94d5-a9899682ec8d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:06.370665 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-7ec1b475-b60d-4b50-94d5-a9899682ec8d service neutron] 10.222.0.61 "GET /v2.0/networks?id=1056c468-8569-46d3-ae01-3e9a87553272 HTTP/1.1" status: 200 len: 910 time: 0.0850444 Dec 08 11:32:06.641642 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-e9e81ee3-fb60-4abc-a09a-5fc8e98bd05b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=fdf2c7c1-363c-4a60-b59f-a320f77b0e66 HTTP/1.1" status: 200 len: 217 time: 0.2556257 Dec 08 11:32:06.718306 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-d6562c81-f10c-455c-b25b-6c7136343151 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:06.719774 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-d6562c81-f10c-455c-b25b-6c7136343151 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=a2e78872-9414-489f-b73b-b06f4460aa93 HTTP/1.1" status: 200 len: 849 time: 0.0536618 Dec 08 11:32:06.755263 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-ed8037b4-a31b-46f3-bda4-c31934592db4 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=1056c468-8569-46d3-ae01-3e9a87553272&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0238640 Dec 08 11:32:06.850836 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-1779acad-3f51-4c69-8963-c9d5f8c983d8 service neutron] 10.222.0.61 "GET /v2.0/networks/1056c468-8569-46d3-ae01-3e9a87553272?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819349 Dec 08 11:32:06.942815 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-48ba13b9-ddb1-4e4b-a5fd-e0a0bdfcf877 req-89a32585-39a3-45da-aac5-012813ace3ff service neutron] 10.222.0.61 "GET /v2.0/networks/1056c468-8569-46d3-ae01-3e9a87553272?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0796289 Dec 08 11:32:07.279857 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0002538-d5b5-4ed5-8738-47a4fe27469a req-26450eb1-8bc5-40b1-bde1-f3490982e153 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:07.281382 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e0002538-d5b5-4ed5-8738-47a4fe27469a req-26450eb1-8bc5-40b1-bde1-f3490982e153 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 944 time: 0.0511143 Dec 08 11:32:07.326660 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e0002538-d5b5-4ed5-8738-47a4fe27469a req-01aa6839-9131-4ec5-a77a-74fe7244379d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395422 Dec 08 11:32:08.441631 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2265bdb5-a27c-484b-ad7d-a1f737b9189a req-07f54292-c57c-437b-8f82-805dfab601be tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:08.442976 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2265bdb5-a27c-484b-ad7d-a1f737b9189a req-07f54292-c57c-437b-8f82-805dfab601be tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 944 time: 0.0463490 Dec 08 11:32:08.487812 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2265bdb5-a27c-484b-ad7d-a1f737b9189a req-36d6495a-7383-413a-b846-ddda7068df99 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391345 Dec 08 11:32:09.367428 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 50990) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:09.466116 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-5993e2c6-f846-4a65-a9ec-75268fa10c05 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:09.540526 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-5993e2c6-f846-4a65-a9ec-75268fa10c05 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:09.544202 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-5993e2c6-f846-4a65-a9ec-75268fa10c05 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:09.580396 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-5993e2c6-f846-4a65-a9ec-75268fa10c05 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=1929d6bddf6646928649418ceacc2830&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2118306 Dec 08 11:32:09.582342 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5993e2c6-f846-4a65-a9ec-75268fa10c05 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7dd3750b-2361-4c26-b466-d383e726a00f,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:09.583170 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 50996) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:09.630834 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:09.651508 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:09.699015 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:09.701788 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:09.702899 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/7dd3750b-2361-4c26-b466-d383e726a00f HTTP/1.1" status: 204 len: 168 time: 0.1187289 Dec 08 11:32:09.710994 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7dd3750b-2361-4c26-b466-d383e726a00f,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:09.718001 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:09.718371 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:09.718712 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:09.719044 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:09.719386 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:09.719817 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:09.720010 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:09.720335 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:09.720665 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:09.721000 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:09.721351 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:09.721662 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:09.721974 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c41954b2-3504-4cae-8656-7e6851255e8d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:09.878247 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-498379d4-b3ab-442d-90c6-d37fe2641b66 req-fda61de1-73c8-4c39-88c5-b3d783972d52 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:09.884752 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-498379d4-b3ab-442d-90c6-d37fe2641b66 req-fda61de1-73c8-4c39-88c5-b3d783972d52 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 944 time: 0.0522449 Dec 08 11:32:09.928856 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-498379d4-b3ab-442d-90c6-d37fe2641b66 req-d69b571b-b16c-4708-930b-4139ad7638c6 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432415 Dec 08 11:32:09.971247 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 51004) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:09.984565 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-d58c86b6-247c-4853-9331-35c64fde411f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.072814 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-d58c86b6-247c-4853-9331-35c64fde411f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.076441 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-d58c86b6-247c-4853-9331-35c64fde411f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.115542 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-d58c86b6-247c-4853-9331-35c64fde411f admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=e80fe35503dd4b2b828c862b1d4c4db0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1430631 Dec 08 11:32:10.116400 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d58c86b6-247c-4853-9331-35c64fde411f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=35e28df8-9300-4f67-b01d-6d62e30ee7ff,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:10.118102 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51006) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:10.165376 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9a1af885-2ab0-44c0-9605-4c70c4d4c72b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.185173 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9a1af885-2ab0-44c0-9605-4c70c4d4c72b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.233064 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9a1af885-2ab0-44c0-9605-4c70c4d4c72b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.235594 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9a1af885-2ab0-44c0-9605-4c70c4d4c72b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.236757 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-9a1af885-2ab0-44c0-9605-4c70c4d4c72b admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/35e28df8-9300-4f67-b01d-6d62e30ee7ff HTTP/1.1" status: 204 len: 168 time: 0.1176581 Dec 08 11:32:10.244127 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a1af885-2ab0-44c0-9605-4c70c4d4c72b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=35e28df8-9300-4f67-b01d-6d62e30ee7ff,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:10.560935 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 51018) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:10.574380 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-04101235-db47-4960-ba8d-029c5bda8ab3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.649601 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-04101235-db47-4960-ba8d-029c5bda8ab3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.653110 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-04101235-db47-4960-ba8d-029c5bda8ab3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.690130 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-04101235-db47-4960-ba8d-029c5bda8ab3 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=a23ee92857224d08bd7dee15d501d045&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1281071 Dec 08 11:32:10.691206 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04101235-db47-4960-ba8d-029c5bda8ab3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd1fa999-9050-41c8-abb7-3ac912e4b08e,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:10.692857 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51020) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:10.738625 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bdabb95a-b53f-45d0-a29f-5299cf301b16 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.759813 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bdabb95a-b53f-45d0-a29f-5299cf301b16 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.806336 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bdabb95a-b53f-45d0-a29f-5299cf301b16 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.809358 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-bdabb95a-b53f-45d0-a29f-5299cf301b16 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:10.810493 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-bdabb95a-b53f-45d0-a29f-5299cf301b16 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/bd1fa999-9050-41c8-abb7-3ac912e4b08e HTTP/1.1" status: 204 len: 168 time: 0.1160853 Dec 08 11:32:10.819324 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdabb95a-b53f-45d0-a29f-5299cf301b16 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd1fa999-9050-41c8-abb7-3ac912e4b08e,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:11.471381 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51056) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:11.563175 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-468826625-network', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:11.583558 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Made reservation on behalf of 3102b9c0f7ea45048750ae3c81085631 for: {'network': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:32:11.586584 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:11.594544 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:11.663746 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device fdf2c7c1-363c-4a60-b59f-a320f77b0e66 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:32:11.666439 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:11.670291 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:11.690871 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] vlan segment allocate from pool success with {'vlan_id': 289, 'physical_network': 'physnet1'} {{(pid=102318) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:32:11.706052 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18816c08-841a-4a06-aa5d-1bb76e44c9f4,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:11.709520 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:11.709867 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.segments_db [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Added segment bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6 of type vlan for network f5a54297-6b64-4f71-b9f2-2f9c14a03187 Dec 08 11:32:11.749831 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:11.759275 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port fdf2c7c1-363c-4a60-b59f-a320f77b0e66, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=fdf2c7c1-363c-4a60-b59f-a320f77b0e66,segment=NetworkSegment(c37df7a5-94f5-4cf8-8161-23e912b124b9),segment_id=c37df7a5-94f5-4cf8-8161-23e912b124b9)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:32:11.770361 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': 'fdf2c7c1-363c-4a60-b59f-a320f77b0e66', 'network_id': '1056c468-8569-46d3-ae01-3e9a87553272', 'port_id': 'fdf2c7c1-363c-4a60-b59f-a320f77b0e66', 'mac_address': 'fa:16:3e:20:e8:06', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 291, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2e78872-9414-489f-b73b-b06f4460aa93', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:32:11.775715 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:11.776668 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:11.777268 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:11.808273 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:11.822904 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fdf2c7c1-363c-4a60-b59f-a320f77b0e66 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:32:11.824571 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3519025 Dec 08 11:32:11.827799 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 51060) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:11.832976 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-f581c86e-10bc-4e2d-8793-a1f1937df11c admin admin] Request body: {'subnet': {'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-468826625-subnet', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'ip_version': 4}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:11.837736 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8de59bf6-de4e-4993-a530-679f502e0763 admin admin] Pushing event updated for resources: {'Network': ['ID=f5a54297-6b64-4f71-b9f2-2f9c14a03187,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:11.844165 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port fdf2c7c1-363c-4a60-b59f-a320f77b0e66, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=fdf2c7c1-363c-4a60-b59f-a320f77b0e66,segment=NetworkSegment(c37df7a5-94f5-4cf8-8161-23e912b124b9),segment_id=c37df7a5-94f5-4cf8-8161-23e912b124b9)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:32:11.848355 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:11.854730 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f581c86e-10bc-4e2d-8793-a1f1937df11c admin admin] Made reservation on behalf of 3102b9c0f7ea45048750ae3c81085631 for: {'subnet': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:32:11.856014 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network f5a54297-6b64-4f71-b9f2-2f9c14a03187 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:32:11.857433 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f581c86e-10bc-4e2d-8793-a1f1937df11c admin admin] Publish callbacks [] for subnet, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:11.950668 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=fdf2c7c1-363c-4a60-b59f-a320f77b0e66,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:11.962290 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:11.962663 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:11.963027 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:11.963372 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:11.963706 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:11.964038 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:11.964367 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:11.964694 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:11.965056 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:11.965419 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:11.965754 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:11.966075 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:11.966400 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:12.028726 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f581c86e-10bc-4e2d-8793-a1f1937df11c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for subnet, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.086928 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f581c86e-10bc-4e2d-8793-a1f1937df11c admin admin] Pushing event updated for resources: {'Subnet': ['ID=07f39602-a4ed-4df9-a6e2-9c0943b66135,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:12.096552 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f581c86e-10bc-4e2d-8793-a1f1937df11c admin admin] Checking segment: {'id': 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 289, 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:12.096902 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f581c86e-10bc-4e2d-8793-a1f1937df11c admin admin] Network hostable DHCP agents. Network: f5a54297-6b64-4f71-b9f2-2f9c14a03187, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102317) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:32:12.113185 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f581c86e-10bc-4e2d-8793-a1f1937df11c admin admin] Network f5a54297-6b64-4f71-b9f2-2f9c14a03187 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102317) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:32:12.122194 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-f581c86e-10bc-4e2d-8793-a1f1937df11c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, f5a54297-6b64-4f71-b9f2-2f9c14a03187) {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:12.126332 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f581c86e-10bc-4e2d-8793-a1f1937df11c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:12.126912 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f581c86e-10bc-4e2d-8793-a1f1937df11c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.134278 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-526391a5-862a-4a5d-8fb0-b9969e6a13c5 None None] Network f5a54297-6b64-4f71-b9f2-2f9c14a03187 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:32:12.143594 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-f581c86e-10bc-4e2d-8793-a1f1937df11c admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3146203 Dec 08 11:32:12.146974 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 51064) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:12.151816 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:12.175357 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7895423', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32171'] for router, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.176684 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7895279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7889720', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7925360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32176'] for router, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.230049 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.362053 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp49d6adb3-88e2-5e36-b97e-28b28be9cdf8-f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'fixed_ips': [{'subnet_id': '07f39602-a4ed-4df9-a6e2-9c0943b66135'}]}} from dv-cinder-819778-3-iscsi. {{(pid=102319) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 08 11:32:12.363035 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.376741 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.515038 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.db_base_plugin_common [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Allocated IP 172.20.0.2 (f5a54297-6b64-4f71-b9f2-2f9c14a03187/07f39602-a4ed-4df9-a6e2-9c0943b66135/090ae454-dacf-4b76-bd03-a9ff7b5fac1c) {{(pid=102319) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:32:12.579854 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.601753 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.657330 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Publish callbacks [] for port, precommit_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.664303 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.703640 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Network f5a54297-6b64-4f71-b9f2-2f9c14a03187 is already hosted by enough agents. {{(pid=102319) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:12.706060 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Allocated IP 172.27.2.86 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/daeaa3c9-fb8a-43b5-b80f-6094f617715e) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:32:12.711420 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.base_scheduler [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Resources bound (agent type, host, resource id): {{(pid=102319) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:12.715732 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Received port after_create {{(pid=102319) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:32:12.724338 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Pushing event updated for resources: {'Port': ['ID=090ae454-dacf-4b76-bd03-a9ff7b5fac1c,revision_number=1']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:12.774442 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Attempting to bind port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:32:12.774714 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Attempting to bind port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 289, 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:32:12.775074 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Attempting to bind port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c on network f5a54297-6b64-4f71-b9f2-2f9c14a03187 {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:12.780335 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 31, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:32:12.780706 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Checking segment: {'id': 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 289, 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:12.781099 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.781522 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Bound using segment: {'id': 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 289, 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:32:12.781997 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Bound port: 090ae454-dacf-4b76-bd03-a9ff7b5fac1c, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 289, 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:32:12.782375 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.851044 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] For port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:32:12.854427 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] For port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=090ae454-dacf-4b76-bd03-a9ff7b5fac1c,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:32:12.858906 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:12.917861 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-078c2d55-e9bc-486d-acae-7f4503fda60a None None] Pushing event updated for resources: {'Port': ['ID=090ae454-dacf-4b76-bd03-a9ff7b5fac1c,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:12.973040 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:13.010138 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:13.049730 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:13.054517 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:13.058010 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:32:13.091724 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Pushing event updated for resources: {'Port': ['ID=daeaa3c9-fb8a-43b5-b80f-6094f617715e,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:13.288912 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:13.482949 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7895264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7889773'] for router, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:13.619365 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 is scheduled to L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f with binding_index 1 {{(pid=102317) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 08 11:32:13.730158 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:32:13.740504 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Sync routers for ids ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:32:13.748916 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] Publish callbacks [] for router, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:13.750842 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-7675e03a-1e85-4842-a4e7-cc113472d0d2 admin admin] 10.222.0.66 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 1.6027977 Dec 08 11:32:13.752345 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Routers {'c3589b0b-43e0-46da-93f9-ec8e7a1164a6'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:32:13.752950 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:31:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:13.753881 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51080) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:13.857528 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29c9df29-9b2d-4449-9abd-028fd7fe3e33 None None] Network f5a54297-6b64-4f71-b9f2-2f9c14a03187 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:32:13.860840 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Set router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:32:13.961971 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-1f91f87e-6d7e-491f-936a-29ff4533b910 None None] Provisioning complete for port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:13.962252 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1f91f87e-6d7e-491f-936a-29ff4533b910 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.041824 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86'}], 'enable_snat': True}, 'gw_port_id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:13Z', 'revision_number': 3, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port': {'id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:50:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 278, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:14.068706 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1f91f87e-6d7e-491f-936a-29ff4533b910 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.079465 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Checking router: c3589b0b-43e0-46da-93f9-ec8e7a1164a6 for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:32:14.080052 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Updating router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 port daeaa3c9-fb8a-43b5-b80f-6094f617715e binding host dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:32:14.109710 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.109923 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-1f91f87e-6d7e-491f-936a-29ff4533b910 None None] For port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=090ae454-dacf-4b76-bd03-a9ff7b5fac1c,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:32:14.115604 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1f91f87e-6d7e-491f-936a-29ff4533b910 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.185487 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f91f87e-6d7e-491f-936a-29ff4533b910 None None] Pushing event updated for resources: {'Port': ['ID=090ae454-dacf-4b76-bd03-a9ff7b5fac1c,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:14.226722 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.288312 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 090ae454-dacf-4b76-bd03-a9ff7b5fac1c up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:14.354447 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:14.354823 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.381507 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-18ba146f-d5bc-46f3-8f0c-6ccbd9a945df None None] Provisioning complete for port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:14.381880 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-18ba146f-d5bc-46f3-8f0c-6ccbd9a945df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.449245 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f36aa4d-c0f0-4ed7-9212-00efd7aee20a req-e51cf6a4-da05-474a-980f-bcf32a2bf88d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:14.451201 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1f36aa4d-c0f0-4ed7-9212-00efd7aee20a req-e51cf6a4-da05-474a-980f-bcf32a2bf88d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 945 time: 0.0974426 Dec 08 11:32:14.507592 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Publish callbacks [] for port, precommit_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.514483 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.517388 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Allocated IP 172.20.0.1 (f5a54297-6b64-4f71-b9f2-2f9c14a03187/07f39602-a4ed-4df9-a6e2-9c0943b66135/00496e9d-a438-4edc-b803-98d3f6b8e626) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:32:14.528782 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1f36aa4d-c0f0-4ed7-9212-00efd7aee20a req-9253da2b-287d-4f34-ba90-46d75a7574a6 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632036 Dec 08 11:32:14.578828 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Pushing event updated for resources: {'Port': ['ID=daeaa3c9-fb8a-43b5-b80f-6094f617715e,revision_number=2']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:14.583302 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Attempting to bind port daeaa3c9-fb8a-43b5-b80f-6094f617715e on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:32:14.583687 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Attempting to bind port daeaa3c9-fb8a-43b5-b80f-6094f617715e by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:32:14.584165 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Attempting to bind port daeaa3c9-fb8a-43b5-b80f-6094f617715e on network d7cb3021-649a-44ca-b3a1-005b3941164e {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:14.589801 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:14.590178 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:14.590542 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:14.590890 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:14.591220 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:14.591562 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:14.591883 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:14.592457 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:14.592569 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:14.592882 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:14.593236 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:14.593559 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:14.593882 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:32:14.600509 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 31, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:32:14.600885 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Checking segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102320) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:14.601311 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.601695 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Bound using segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:32:14.602165 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Bound port: daeaa3c9-fb8a-43b5-b80f-6094f617715e, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:32:14.602560 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.640641 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.669281 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] For port daeaa3c9-fb8a-43b5-b80f-6094f617715e, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102320) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:32:14.672279 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] For port daeaa3c9-fb8a-43b5-b80f-6094f617715e, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=daeaa3c9-fb8a-43b5-b80f-6094f617715e,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102320) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:32:14.675584 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.676026 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.715261 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Network f5a54297-6b64-4f71-b9f2-2f9c14a03187 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:14.719585 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:14.727164 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:32:14.727164 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7898680'] for router_interface, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:14.744589 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a2a1e65-61cd-4bd7-bb15-c5a2097c6242 None None] Pushing event updated for resources: {'Port': ['ID=daeaa3c9-fb8a-43b5-b80f-6094f617715e,revision_number=3']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:14.758652 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Routers {'c3589b0b-43e0-46da-93f9-ec8e7a1164a6'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:32:14.759352 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:31:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:14.764087 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Pushing event updated for resources: {'Port': ['ID=00496e9d-a438-4edc-b803-98d3f6b8e626,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:14.881685 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] Set router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:32:14.900735 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d7912b63-dea5-4bea-9e9d-63f1ddc70ec7 req-7b8dc790-63af-41c1-9220-d65b36c3ef40 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0850246 Dec 08 11:32:14.908039 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:15.033215 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-23e14d63-f7e2-4a74-bf71-62059e6b8b08 None None] Provisioning complete for port 00496e9d-a438-4edc-b803-98d3f6b8e626 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:15.033757 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-23e14d63-f7e2-4a74-bf71-62059e6b8b08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:15.043384 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7912b63-dea5-4bea-9e9d-63f1ddc70ec7 req-7430719d-0ff2-4689-8b9b-3b161dd9f862 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:15.044885 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d7912b63-dea5-4bea-9e9d-63f1ddc70ec7 req-7430719d-0ff2-4689-8b9b-3b161dd9f862 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 1099 time: 0.0934780 Dec 08 11:32:15.068997 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86'}], 'enable_snat': True}, 'gw_port_id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:13Z', 'revision_number': 3, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port': {'id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:50:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 278, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:15.111790 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-742a3670-e0ac-469d-9a33-c872aca7c044 None None] The sync data for ids ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'] in dv-cinder-819778-3-iscsi is: [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86'}], 'enable_snat': True}, 'gw_port_id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:13Z', 'revision_number': 3, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port': {'id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:50:b3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 278, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:32:15.118959 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-23e14d63-f7e2-4a74-bf71-62059e6b8b08 None None] Port 00496e9d-a438-4edc-b803-98d3f6b8e626 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:32:15.155852 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['fdf2c7c1-363c-4a60-b59f-a320f77b0e66'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:32:15.189308 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:15.199013 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:15.199711 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8074899', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7897000'] for router_interface, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:15.240758 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7912b63-dea5-4bea-9e9d-63f1ddc70ec7 req-41c9b9d2-7d4c-42c7-9145-88359530ef61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:15.242259 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d7912b63-dea5-4bea-9e9d-63f1ddc70ec7 req-41c9b9d2-7d4c-42c7-9145-88359530ef61 service neutron] 10.222.0.61 "GET /v2.0/networks?id=6e4bda07-1ae1-4be4-bf28-e94211f51919 HTTP/1.1" status: 200 len: 914 time: 0.1676464 Dec 08 11:32:15.371719 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d7912b63-dea5-4bea-9e9d-63f1ddc70ec7 req-95eeda13-1de9-4604-a94b-0b472ec61c53 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d9ecab87-157e-4ccb-8423-2248bb8451ea HTTP/1.1" status: 200 len: 217 time: 0.1128259 Dec 08 11:32:15.426907 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Pushing event updated for resources: {'Port': ['ID=00496e9d-a438-4edc-b803-98d3f6b8e626,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:15.465842 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Network f5a54297-6b64-4f71-b9f2-2f9c14a03187 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:15.467521 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:15.470484 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7912b63-dea5-4bea-9e9d-63f1ddc70ec7 req-9de24aac-0dbb-4942-bd5b-9bfce421ee54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:15.472274 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d7912b63-dea5-4bea-9e9d-63f1ddc70ec7 req-9de24aac-0dbb-4942-bd5b-9bfce421ee54 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=d6b1fb0e-d38f-47ca-a647-53b824c47e76 HTTP/1.1" status: 200 len: 853 time: 0.0846081 Dec 08 11:32:15.655196 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:32:15.689472 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d7912b63-dea5-4bea-9e9d-63f1ddc70ec7 req-395f5f9a-3f09-4974-84d2-cc8d02005ed6 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=6e4bda07-1ae1-4be4-bf28-e94211f51919&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0498648 Dec 08 11:32:15.845914 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-84e5a385-5383-4131-8126-2f419acebbba None None] Provisioning complete for port 00496e9d-a438-4edc-b803-98d3f6b8e626 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:15.846293 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-84e5a385-5383-4131-8126-2f419acebbba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:15.871256 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4bb42c1-4e48-446d-b34d-90c5368f0a42 req-1461b5dc-592e-47b2-afb4-5aa7f1131c98 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:15.872890 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e4bb42c1-4e48-446d-b34d-90c5368f0a42 req-1461b5dc-592e-47b2-afb4-5aa7f1131c98 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 945 time: 0.1978164 Dec 08 11:32:15.882245 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-84e5a385-5383-4131-8126-2f419acebbba None None] Port 00496e9d-a438-4edc-b803-98d3f6b8e626 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:32:15.928591 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:32:15.936903 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-61ec844c-1133-4d61-88df-9d9582550874 admin admin] 10.222.0.66 "PUT /v2.0/routers/c3589b0b-43e0-46da-93f9-ec8e7a1164a6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1820040 Dec 08 11:32:15.940593 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d7912b63-dea5-4bea-9e9d-63f1ddc70ec7 req-683d510b-40bd-48b7-9c78-15065f4f881d service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2241144 Dec 08 11:32:16.006267 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e4bb42c1-4e48-446d-b34d-90c5368f0a42 req-ec0cf572-2f65-4630-89a6-8a058cc50fd6 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1216011 Dec 08 11:32:16.057485 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d7912b63-dea5-4bea-9e9d-63f1ddc70ec7 req-82de95ac-d9aa-4d59-b842-e562874cc150 service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1050179 Dec 08 11:32:16.260611 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device daeaa3c9-fb8a-43b5-b80f-6094f617715e up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:16.315398 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port daeaa3c9-fb8a-43b5-b80f-6094f617715e triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:16.315827 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:16.393934 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:16.415264 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port daeaa3c9-fb8a-43b5-b80f-6094f617715e, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=daeaa3c9-fb8a-43b5-b80f-6094f617715e,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:32:16.421539 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:16.422328 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 090ae454-dacf-4b76-bd03-a9ff7b5fac1c up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:16.460787 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51126) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:16.465957 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-2024163828-network', 'tenant_id': '768a297d7e694199b80b2fa7f4671866'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:16.488247 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Made reservation on behalf of 768a297d7e694199b80b2fa7f4671866 for: {'network': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:32:16.490802 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:16.501489 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=daeaa3c9-fb8a-43b5-b80f-6094f617715e,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:16.501686 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:16.512386 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:16.512678 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:16.581830 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:16.590311 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:16.615962 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] vlan segment allocate from pool success with {'vlan_id': 263, 'physical_network': 'physnet1'} {{(pid=102318) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:32:16.625123 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4c96aa3-2204-4de2-b1ac-5ce9ef694a9b,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:16.631526 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:16.631866 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.segments_db [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Added segment 15bdd0ed-936d-41c5-b3bd-63dca39d9789 of type vlan for network 6a5ef37d-afdd-4d25-a278-64647e2c4759 Dec 08 11:32:16.680045 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:16.721566 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:16.722610 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:16.723324 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:16.932472 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Sync routers for ids ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:32:16.943688 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Routers {'c3589b0b-43e0-46da-93f9-ec8e7a1164a6'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:32:16.944413 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:31:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:17.019480 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.5572019 Dec 08 11:32:17.022473 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 51142) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:17.028253 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-cba1b2ee-8d50-47e2-afd7-2a3725b46721 admin admin] Request body: {'subnet': {'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-2024163828-subnet', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'ip_version': 4}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:17.032511 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d13d2d9-0e39-4a1f-8ea8-97303ba46988 admin admin] Pushing event updated for resources: {'Network': ['ID=6a5ef37d-afdd-4d25-a278-64647e2c4759,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:17.057915 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cba1b2ee-8d50-47e2-afd7-2a3725b46721 admin admin] Made reservation on behalf of 768a297d7e694199b80b2fa7f4671866 for: {'subnet': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:32:17.058868 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network 6a5ef37d-afdd-4d25-a278-64647e2c4759 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:32:17.060560 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cba1b2ee-8d50-47e2-afd7-2a3725b46721 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:17.139886 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Set router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:32:17.163179 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b3c00fc-c196-456a-97cd-21b5b3b60aae req-c92c3312-4425-4ece-9008-08a38984d0e8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:17.164718 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7b3c00fc-c196-456a-97cd-21b5b3b60aae req-c92c3312-4425-4ece-9008-08a38984d0e8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 945 time: 0.0574496 Dec 08 11:32:17.217824 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7b3c00fc-c196-456a-97cd-21b5b3b60aae req-c62228e1-d48a-4aad-a35c-0cce39a44a02 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440345 Dec 08 11:32:17.254777 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cba1b2ee-8d50-47e2-afd7-2a3725b46721 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for subnet, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:17.311849 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cba1b2ee-8d50-47e2-afd7-2a3725b46721 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6ad3a8d0-0889-4cb7-801c-def529056ea9,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:17.326857 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cba1b2ee-8d50-47e2-afd7-2a3725b46721 admin admin] Checking segment: {'id': '15bdd0ed-936d-41c5-b3bd-63dca39d9789', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:17.327758 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cba1b2ee-8d50-47e2-afd7-2a3725b46721 admin admin] Network hostable DHCP agents. Network: 6a5ef37d-afdd-4d25-a278-64647e2c4759, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102317) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:32:17.346451 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cba1b2ee-8d50-47e2-afd7-2a3725b46721 admin admin] Network 6a5ef37d-afdd-4d25-a278-64647e2c4759 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102317) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:32:17.357638 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-cba1b2ee-8d50-47e2-afd7-2a3725b46721 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, 6a5ef37d-afdd-4d25-a278-64647e2c4759) {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:17.361017 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86'}], 'enable_snat': True}, 'gw_port_id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:14Z', 'revision_number': 4, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port': {'id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:50:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 278, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '00496e9d-a438-4edc-b803-98d3f6b8e626', 'name': '', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'mac_address': 'fa:16:3e:37:98:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 279, 'fixed_ips': [{'subnet_id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:14Z', 'updated_at': '2021-12-08T11:32:14Z', 'revision_number': 2, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'subnets': [{'id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:17.367099 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-172e9bd0-6072-4065-8234-9f442f2c2b4a None None] Network 6a5ef37d-afdd-4d25-a278-64647e2c4759 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:32:17.367284 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cba1b2ee-8d50-47e2-afd7-2a3725b46721 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:17.368095 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cba1b2ee-8d50-47e2-afd7-2a3725b46721 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:17.388622 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51148) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:17.388931 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-cba1b2ee-8d50-47e2-afd7-2a3725b46721 admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3649459 Dec 08 11:32:17.394093 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-2024163828-router', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:17.408411 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Checking router: c3589b0b-43e0-46da-93f9-ec8e7a1164a6 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:32:17.408766 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Updating router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 port 00496e9d-a438-4edc-b803-98d3f6b8e626 binding host dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:32:17.425441 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7895423', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32171'] for router, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:17.426523 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7895279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7889720', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7925360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32176'] for router, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:17.464567 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:17.491092 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:17.638837 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:17.682322 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:17.727607 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp49d6adb3-88e2-5e36-b97e-28b28be9cdf8-6a5ef37d-afdd-4d25-a278-64647e2c4759', 'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759', 'project_id': '768a297d7e694199b80b2fa7f4671866', 'fixed_ips': [{'subnet_id': '6ad3a8d0-0889-4cb7-801c-def529056ea9'}]}} from dv-cinder-819778-3-iscsi. {{(pid=102319) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 08 11:32:17.728459 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:17.868461 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:17.901111 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.004047 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.db_base_plugin_common [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Allocated IP 172.20.0.2 (6a5ef37d-afdd-4d25-a278-64647e2c4759/6ad3a8d0-0889-4cb7-801c-def529056ea9/f0d99c11-f976-4a6b-a95d-292a9bdeb5aa) {{(pid=102319) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:32:18.019527 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Publish callbacks [] for port, precommit_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.030379 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.042946 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Allocated IP 172.27.2.61 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/cf24cf71-3d0f-4982-87dd-2a3f70f2b08e) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:32:18.179304 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.222674 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.235256 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device daeaa3c9-fb8a-43b5-b80f-6094f617715e up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:18.253186 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3675c54c-cce9-43d7-b192-86fa0b5fb872 None None] Pushing event updated for resources: {'Port': ['ID=00496e9d-a438-4edc-b803-98d3f6b8e626,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:18.278158 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:18.284682 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:18.294115 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:32:18.377991 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Pushing event updated for resources: {'Port': ['ID=cf24cf71-3d0f-4982-87dd-2a3f70f2b08e,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:18.391144 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Attempting to bind port 00496e9d-a438-4edc-b803-98d3f6b8e626 on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:32:18.391692 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Attempting to bind port 00496e9d-a438-4edc-b803-98d3f6b8e626 by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 289, 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:32:18.391871 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Attempting to bind port 00496e9d-a438-4edc-b803-98d3f6b8e626 on network f5a54297-6b64-4f71-b9f2-2f9c14a03187 {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:18.426466 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 31, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:32:18.426743 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Checking segment: {'id': 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 289, 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:18.427141 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.427576 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Bound using segment: {'id': 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 289, 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:32:18.428065 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Bound port: 00496e9d-a438-4edc-b803-98d3f6b8e626, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 289, 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:32:18.428457 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.443936 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port daeaa3c9-fb8a-43b5-b80f-6094f617715e triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:18.444313 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.460421 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f9931cd-fc86-4744-9045-b94bfaf18ffc req-c1fa6553-1222-4641-8125-a1458f2e7abb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:18.461977 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9f9931cd-fc86-4744-9045-b94bfaf18ffc req-c1fa6553-1222-4641-8125-a1458f2e7abb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 945 time: 0.1299148 Dec 08 11:32:18.520069 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Publish callbacks [] for port, precommit_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.524724 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-e425677e-7bd4-4b12-93d0-56b65474a03f None None] Provisioning complete for port 00496e9d-a438-4edc-b803-98d3f6b8e626 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:18.525086 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e425677e-7bd4-4b12-93d0-56b65474a03f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.557775 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.590229 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9f9931cd-fc86-4744-9045-b94bfaf18ffc req-76089432-45dc-4d78-bb39-0b1377db9d96 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1188054 Dec 08 11:32:18.607170 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.623163 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] For port 00496e9d-a438-4edc-b803-98d3f6b8e626, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:32:18.632126 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-e425677e-7bd4-4b12-93d0-56b65474a03f None None] Port 00496e9d-a438-4edc-b803-98d3f6b8e626 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:32:18.634624 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Network 6a5ef37d-afdd-4d25-a278-64647e2c4759 is already hosted by enough agents. {{(pid=102319) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:18.645835 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] For port 00496e9d-a438-4edc-b803-98d3f6b8e626, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=00496e9d-a438-4edc-b803-98d3f6b8e626,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:32:18.649361 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.base_scheduler [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Resources bound (agent type, host, resource id): {{(pid=102319) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:18.669376 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Received port after_create {{(pid=102319) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:32:18.678173 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.700449 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Pushing event updated for resources: {'Port': ['ID=f0d99c11-f976-4a6b-a95d-292a9bdeb5aa,revision_number=1']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:18.774470 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device fdf2c7c1-363c-4a60-b59f-a320f77b0e66 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:18.827104 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Attempting to bind port f0d99c11-f976-4a6b-a95d-292a9bdeb5aa on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:32:18.827478 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Attempting to bind port f0d99c11-f976-4a6b-a95d-292a9bdeb5aa by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '15bdd0ed-936d-41c5-b3bd-63dca39d9789', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:32:18.827851 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Attempting to bind port f0d99c11-f976-4a6b-a95d-292a9bdeb5aa on network 6a5ef37d-afdd-4d25-a278-64647e2c4759 {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:18.844382 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7895264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7889773'] for router, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.854528 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Routers {'c3589b0b-43e0-46da-93f9-ec8e7a1164a6'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:32:18.855096 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:31:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:18.861634 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 31, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:32:18.861634 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Checking segment: {'id': '15bdd0ed-936d-41c5-b3bd-63dca39d9789', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:18.862008 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.862408 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Bound using segment: {'id': '15bdd0ed-936d-41c5-b3bd-63dca39d9789', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:32:18.862887 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Bound port: f0d99c11-f976-4a6b-a95d-292a9bdeb5aa, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '15bdd0ed-936d-41c5-b3bd-63dca39d9789', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:32:18.863270 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:18.963862 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3675c54c-cce9-43d7-b192-86fa0b5fb872 None None] Pushing event updated for resources: {'Port': ['ID=00496e9d-a438-4edc-b803-98d3f6b8e626,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:19.022287 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Router b92702ae-4c49-4f76-81b7-ca5150f7e9c2 is scheduled to L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f with binding_index 1 {{(pid=102318) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 08 11:32:19.035890 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] Set router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:32:19.068840 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port fdf2c7c1-363c-4a60-b59f-a320f77b0e66 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:32:19.075393 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-15bb5ab2-e419-4574-994a-96e97f7d9214 None None] Provisioning complete for port 00496e9d-a438-4edc-b803-98d3f6b8e626 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:19.075989 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-15bb5ab2-e419-4574-994a-96e97f7d9214 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:19.090513 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port fdf2c7c1-363c-4a60-b59f-a320f77b0e66 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:19.090886 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:19.197793 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] For port f0d99c11-f976-4a6b-a95d-292a9bdeb5aa, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:32:19.211067 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:32:19.225240 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Sync routers for ids ['b92702ae-4c49-4f76-81b7-ca5150f7e9c2'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:32:19.236521 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Routers {'b92702ae-4c49-4f76-81b7-ca5150f7e9c2'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:32:19.237139 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:31:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['b92702ae-4c49-4f76-81b7-ca5150f7e9c2'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:19.238771 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd2db9e-2d8b-4edf-8fd3-9198cba79b26 req-7965d90b-e313-49f4-9704-8e64227556b7 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:19.240460 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ecd2db9e-2d8b-4edf-8fd3-9198cba79b26 req-7965d90b-e313-49f4-9704-8e64227556b7 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 945 time: 0.0648274 Dec 08 11:32:19.243925 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] Publish callbacks [] for router, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:19.245090 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-24599c2b-e153-4520-950e-2a99b49e82f8 admin admin] 10.222.0.66 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 1.8549216 Dec 08 11:32:19.247906 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 51192) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:19.266959 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] For port f0d99c11-f976-4a6b-a95d-292a9bdeb5aa, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=f0d99c11-f976-4a6b-a95d-292a9bdeb5aa,segment=NetworkSegment(15bdd0ed-936d-41c5-b3bd-63dca39d9789),segment_id=15bdd0ed-936d-41c5-b3bd-63dca39d9789)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:32:19.294665 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:19.323268 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ecd2db9e-2d8b-4edf-8fd3-9198cba79b26 req-b5cc3fdd-f75c-4066-98fc-119c0008a02a tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625985 Dec 08 11:32:19.388105 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Set router b92702ae-4c49-4f76-81b7-ca5150f7e9c2 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:32:19.513971 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b2d9cd4-6839-40f6-95a2-74751739086c None None] Pushing event updated for resources: {'Port': ['ID=f0d99c11-f976-4a6b-a95d-292a9bdeb5aa,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:19.553871 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-15bb5ab2-e419-4574-994a-96e97f7d9214 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:19.556955 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:19.637824 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd60041b9-3a0a-495a-aaa8-0da5f57e7e42', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fdf2c7c1-363c-4a60-b59f-a320f77b0e66'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:32:19.638938 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-626dcbb1-c6fc-46d9-adfe-256ec9341184" -d '{"events": [{"server_uuid": "d60041b9-3a0a-495a-aaa8-0da5f57e7e42", "name": "network-vif-plugged", "status": "completed", "tag": "fdf2c7c1-363c-4a60-b59f-a320f77b0e66"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:32:19.696464 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port fdf2c7c1-363c-4a60-b59f-a320f77b0e66, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=fdf2c7c1-363c-4a60-b59f-a320f77b0e66,segment=NetworkSegment(c37df7a5-94f5-4cf8-8161-23e912b124b9),segment_id=c37df7a5-94f5-4cf8-8161-23e912b124b9)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:32:19.708938 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-15bb5ab2-e419-4574-994a-96e97f7d9214 None None] For port 00496e9d-a438-4edc-b803-98d3f6b8e626, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=00496e9d-a438-4edc-b803-98d3f6b8e626,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:32:19.715383 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:19.721865 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-15bb5ab2-e419-4574-994a-96e97f7d9214 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:19.751558 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'name': 'tempest-TestMinimumBasicScenario-2024163828-router', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61'}], 'enable_snat': True}, 'gw_port_id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:32:18Z', 'revision_number': 3, 'project_id': '768a297d7e694199b80b2fa7f4671866', 'gw_port': {'id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:09:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:32:18Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:19.794427 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a60b570-9e15-447d-b6e3-faff1c5ca631 req-323d373e-67f9-4aeb-b78c-bd9ac0d3fde3 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:19.795953 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5a60b570-9e15-447d-b6e3-faff1c5ca631 req-323d373e-67f9-4aeb-b78c-bd9ac0d3fde3 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 946 time: 0.0795708 Dec 08 11:32:19.887309 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Checking router: b92702ae-4c49-4f76-81b7-ca5150f7e9c2 for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:32:19.898330 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Updating router b92702ae-4c49-4f76-81b7-ca5150f7e9c2 port cf24cf71-3d0f-4982-87dd-2a3f70f2b08e binding host dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:32:19.940841 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5a60b570-9e15-447d-b6e3-faff1c5ca631 req-beea65e4-33f3-4dd1-9604-e440c4d74c69 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1329205 Dec 08 11:32:19.953542 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51220) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:19.967253 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:32:19.983051 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.057125 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:32:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a4345c08-1024-45ea-abd8-521e0775d91f x-openstack-request-id: req-a4345c08-1024-45ea-abd8-521e0775d91f {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:32:20.057582 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d60041b9-3a0a-495a-aaa8-0da5f57e7e42", "name": "network-vif-plugged", "status": "completed", "tag": "fdf2c7c1-363c-4a60-b59f-a320f77b0e66", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:32:20.058061 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-a4345c08-1024-45ea-abd8-521e0775d91f {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:32:20.058647 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd60041b9-3a0a-495a-aaa8-0da5f57e7e42', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fdf2c7c1-363c-4a60-b59f-a320f77b0e66', 'code': 200} Dec 08 11:32:20.065956 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.096735 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=fdf2c7c1-363c-4a60-b59f-a320f77b0e66,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:20.118216 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da0f92a5-05b8-45b0-9c5b-0faa2fa72714 req-6a943cd7-7ddb-4f97-9e72-e6b30ce50f8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:20.119953 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-da0f92a5-05b8-45b0-9c5b-0faa2fa72714 req-6a943cd7-7ddb-4f97-9e72-e6b30ce50f8a service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 1099 time: 0.1132345 Dec 08 11:32:20.158146 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86'}], 'enable_snat': True}, 'gw_port_id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:14Z', 'revision_number': 4, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port': {'id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:50:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 278, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '00496e9d-a438-4edc-b803-98d3f6b8e626', 'name': '', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'mac_address': 'fa:16:3e:37:98:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 279, 'fixed_ips': [{'subnet_id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:14Z', 'updated_at': '2021-12-08T11:32:18Z', 'revision_number': 4, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'subnets': [{'id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:20.207916 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9edaa79b-b24c-44f0-8a34-d23309a0921e None None] The sync data for ids ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'] in dv-cinder-819778-3-iscsi is: [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86'}], 'enable_snat': True}, 'gw_port_id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:14Z', 'revision_number': 4, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port': {'id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:50:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 278, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '00496e9d-a438-4edc-b803-98d3f6b8e626', 'name': '', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'mac_address': 'fa:16:3e:37:98:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 279, 'fixed_ips': [{'subnet_id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:14Z', 'updated_at': '2021-12-08T11:32:18Z', 'revision_number': 4, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'subnets': [{'id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:32:20.216424 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15bb5ab2-e419-4574-994a-96e97f7d9214 None None] Pushing event updated for resources: {'Port': ['ID=00496e9d-a438-4edc-b803-98d3f6b8e626,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:20.263529 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-274acfd3-5914-4967-82bc-bf18a74a1664 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.387174 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Publish callbacks [] for port, precommit_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.408181 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.421817 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-da0f92a5-05b8-45b0-9c5b-0faa2fa72714 req-c04e6da4-a54c-4fe5-a34a-df7b66d0699c service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2867386 Dec 08 11:32:20.458280 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device f0d99c11-f976-4a6b-a95d-292a9bdeb5aa up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:20.534936 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-274acfd3-5914-4967-82bc-bf18a74a1664 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.579854 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Attempting to bind port cf24cf71-3d0f-4982-87dd-2a3f70f2b08e on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:32:20.584069 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Attempting to bind port cf24cf71-3d0f-4982-87dd-2a3f70f2b08e by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:32:20.584744 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Attempting to bind port cf24cf71-3d0f-4982-87dd-2a3f70f2b08e on network d7cb3021-649a-44ca-b3a1-005b3941164e {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:20.588605 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-274acfd3-5914-4967-82bc-bf18a74a1664 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.593367 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port f0d99c11-f976-4a6b-a95d-292a9bdeb5aa triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:20.593861 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.605334 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 31, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:32:20.605701 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Checking segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102320) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:20.606099 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.606491 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Bound using segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:32:20.606959 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Bound port: cf24cf71-3d0f-4982-87dd-2a3f70f2b08e, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:32:20.607408 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.698408 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89df89e7-17ca-42e4-9349-27cf5e5282e4 None None] Pushing event updated for resources: {'Port': ['ID=cf24cf71-3d0f-4982-87dd-2a3f70f2b08e,revision_number=2']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:20.736333 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-274acfd3-5914-4967-82bc-bf18a74a1664 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5971518c-45a5-4bb1-9a38-bd521ce2501f,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:20.745344 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] For port cf24cf71-3d0f-4982-87dd-2a3f70f2b08e, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102320) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:32:20.749615 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] For port cf24cf71-3d0f-4982-87dd-2a3f70f2b08e, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=cf24cf71-3d0f-4982-87dd-2a3f70f2b08e,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102320) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:32:20.750128 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-274acfd3-5914-4967-82bc-bf18a74a1664 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=54a24638da80426aa29fbfd7bfbb5e22&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7954061 Dec 08 11:32:20.752820 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51238) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:20.754437 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Allocated IP 172.20.0.1 (6a5ef37d-afdd-4d25-a278-64647e2c4759/6ad3a8d0-0889-4cb7-801c-def529056ea9/a124b6f3-37e6-4602-830a-3285a1585a50) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:32:20.760959 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.783405 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e7156f0-13bb-40c6-9eb8-9c0490d15e93 req-9f69a554-5fe8-4516-8f4a-0301fdd520ac tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:20.786379 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7e7156f0-13bb-40c6-9eb8-9c0490d15e93 req-9f69a554-5fe8-4516-8f4a-0301fdd520ac tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 945 time: 0.2766511 Dec 08 11:32:20.813182 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.874332 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Routers {'b92702ae-4c49-4f76-81b7-ca5150f7e9c2'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:32:20.874949 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:31:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['b92702ae-4c49-4f76-81b7-ca5150f7e9c2'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:20.892270 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port f0d99c11-f976-4a6b-a95d-292a9bdeb5aa, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=f0d99c11-f976-4a6b-a95d-292a9bdeb5aa,segment=NetworkSegment(15bdd0ed-936d-41c5-b3bd-63dca39d9789),segment_id=15bdd0ed-936d-41c5-b3bd-63dca39d9789)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:32:20.901026 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.924551 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7e7156f0-13bb-40c6-9eb8-9c0490d15e93 req-bdcb3333-6e17-4541-acab-4cd757e7df2c tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1273952 Dec 08 11:32:20.935431 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-489e535c-136e-47be-8adc-814ee0785ef6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:20.948464 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89df89e7-17ca-42e4-9349-27cf5e5282e4 None None] Pushing event updated for resources: {'Port': ['ID=cf24cf71-3d0f-4982-87dd-2a3f70f2b08e,revision_number=3']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:20.988456 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-489e535c-136e-47be-8adc-814ee0785ef6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:21.009752 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=f0d99c11-f976-4a6b-a95d-292a9bdeb5aa,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:21.019795 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:21.059221 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-489e535c-136e-47be-8adc-814ee0785ef6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:21.062795 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-489e535c-136e-47be-8adc-814ee0785ef6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:21.066450 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-489e535c-136e-47be-8adc-814ee0785ef6 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/5971518c-45a5-4bb1-9a38-bd521ce2501f HTTP/1.1" status: 204 len: 168 time: 0.3101101 Dec 08 11:32:21.066584 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c085c89c-e158-45f8-9756-56458b9d8aad None None] Network 6a5ef37d-afdd-4d25-a278-64647e2c4759 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:32:21.078714 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-489e535c-136e-47be-8adc-814ee0785ef6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5971518c-45a5-4bb1-9a38-bd521ce2501f,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:21.110544 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:21.150479 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] Set router b92702ae-4c49-4f76-81b7-ca5150f7e9c2 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:32:21.173334 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Network 6a5ef37d-afdd-4d25-a278-64647e2c4759 is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:21.180681 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:21.188260 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:32:21.188746 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7898680'] for router_interface, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:21.216981 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-098fda69-fddf-4921-b4ba-624e8d064e9a req-d707c6c2-cbb2-4aa2-b10b-341fb15df7bb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:21.233883 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-098fda69-fddf-4921-b4ba-624e8d064e9a req-d707c6c2-cbb2-4aa2-b10b-341fb15df7bb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 946 time: 0.1266937 Dec 08 11:32:21.267528 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-498af139-1ab9-4158-a80d-ef73f9cc6e49 None None] Provisioning complete for port f0d99c11-f976-4a6b-a95d-292a9bdeb5aa triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:21.268232 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-498af139-1ab9-4158-a80d-ef73f9cc6e49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:21.339654 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Pushing event updated for resources: {'Port': ['ID=a124b6f3-37e6-4602-830a-3285a1585a50,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:21.343953 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-098fda69-fddf-4921-b4ba-624e8d064e9a req-2c2b23b5-35ef-49ac-b6f1-f5d833f273f1 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1091413 Dec 08 11:32:21.480992 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:21.558161 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'name': 'tempest-TestMinimumBasicScenario-2024163828-router', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61'}], 'enable_snat': True}, 'gw_port_id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:32:18Z', 'revision_number': 3, 'project_id': '768a297d7e694199b80b2fa7f4671866', 'gw_port': {'id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:09:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:32:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:21.591865 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-824ede2b-44b6-4e39-ac1b-ac42ce45511b None None] The sync data for ids ['b92702ae-4c49-4f76-81b7-ca5150f7e9c2'] in dv-cinder-819778-3-iscsi is: [{'id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'name': 'tempest-TestMinimumBasicScenario-2024163828-router', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61'}], 'enable_snat': True}, 'gw_port_id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:32:18Z', 'revision_number': 3, 'project_id': '768a297d7e694199b80b2fa7f4671866', 'gw_port': {'id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:09:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:32:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:32:21.742144 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:21.763285 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:21.764098 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8074899', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7897000'] for router_interface, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:21.812485 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-f15cd1bd-9278-4072-abaa-383b2c11ee8c None None] Provisioning complete for port a124b6f3-37e6-4602-830a-3285a1585a50 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:21.812930 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-f15cd1bd-9278-4072-abaa-383b2c11ee8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:21.915563 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-f15cd1bd-9278-4072-abaa-383b2c11ee8c None None] Port a124b6f3-37e6-4602-830a-3285a1585a50 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:32:21.951176 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-f15cd1bd-9278-4072-abaa-383b2c11ee8c None None] Provisioning complete for port f0d99c11-f976-4a6b-a95d-292a9bdeb5aa triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:21.951549 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-f15cd1bd-9278-4072-abaa-383b2c11ee8c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:21.956775 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Pushing event updated for resources: {'Port': ['ID=a124b6f3-37e6-4602-830a-3285a1585a50,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:22.114132 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Network 6a5ef37d-afdd-4d25-a278-64647e2c4759 is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:22.118042 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:22.314642 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-1d4576a3-3c8e-4377-a9c9-d1614f685786 None None] Provisioning complete for port a124b6f3-37e6-4602-830a-3285a1585a50 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:22.320549 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1d4576a3-3c8e-4377-a9c9-d1614f685786 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:22.337277 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b71ee28e-7307-49e6-b9ce-1e5d9d4c8bcb req-ea07e41b-11ca-4e27-8dec-52aff32f2a56 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:22.349501 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b71ee28e-7307-49e6-b9ce-1e5d9d4c8bcb req-ea07e41b-11ca-4e27-8dec-52aff32f2a56 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 945 time: 0.2082951 Dec 08 11:32:22.525894 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b71ee28e-7307-49e6-b9ce-1e5d9d4c8bcb req-7d071c9d-6337-47d5-a0fd-8a7f3dbbf628 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1664913 Dec 08 11:32:22.527631 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 51282) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:22.562244 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device cf24cf71-3d0f-4982-87dd-2a3f70f2b08e up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:22.623255 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Router b92702ae-4c49-4f76-81b7-ca5150f7e9c2 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:32:22.691108 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d2e640e3-d52f-4263-ac9f-de5d6faacb10 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:22.707116 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-1d4576a3-3c8e-4377-a9c9-d1614f685786 None None] Port a124b6f3-37e6-4602-830a-3285a1585a50 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:32:22.716774 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70136959-08e7-4323-b582-a13034eeb407 req-092dd899-54b1-4618-95d1-90bd0773614e tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:22.724814 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-70136959-08e7-4323-b582-a13034eeb407 req-092dd899-54b1-4618-95d1-90bd0773614e tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 946 time: 0.1026838 Dec 08 11:32:22.734933 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port cf24cf71-3d0f-4982-87dd-2a3f70f2b08e triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:22.735303 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:22.740974 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f1aa41de-f326-46a2-9c06-372c0a354c69 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:22.838111 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19244556-2b86-49b0-abb9-fe76a139e6a2 req-fb0debbf-c664-459f-8732-a7e4780fb6ea tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:22.839639 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-19244556-2b86-49b0-abb9-fe76a139e6a2 req-fb0debbf-c664-459f-8732-a7e4780fb6ea tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.61 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 945 time: 0.1116045 Dec 08 11:32:22.856426 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-70136959-08e7-4323-b582-a13034eeb407 req-677a5c95-60ce-48a1-af8b-627ebf181569 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1257656 Dec 08 11:32:22.875196 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:32:22.881765 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-911c5db6-63e3-4282-98af-1ade5399bd6d admin admin] 10.222.0.66 "PUT /v2.0/routers/b92702ae-4c49-4f76-81b7-ca5150f7e9c2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6322505 Dec 08 11:32:22.916113 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-d56e91c8-715d-4d8b-954d-6300cf18bca0 None None] Provisioning complete for port a124b6f3-37e6-4602-830a-3285a1585a50 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:22.916676 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d56e91c8-715d-4d8b-954d-6300cf18bca0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:22.977222 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f1aa41de-f326-46a2-9c06-372c0a354c69 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:22.984272 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f1aa41de-f326-46a2-9c06-372c0a354c69 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:23.016027 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:23.028532 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-d56e91c8-715d-4d8b-954d-6300cf18bca0 None None] Port a124b6f3-37e6-4602-830a-3285a1585a50 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:32:23.056167 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-19244556-2b86-49b0-abb9-fe76a139e6a2 req-9d52f3f3-46e0-4b06-8bcd-c309d09fc786 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Deleting port 8e4b1127-3db2-4f93-a731-315192c060b3 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:32:23.056514 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-19244556-2b86-49b0-abb9-fe76a139e6a2 req-9d52f3f3-46e0-4b06-8bcd-c309d09fc786 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:23.071355 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1aa41de-f326-46a2-9c06-372c0a354c69 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e1e03bad-d41b-4e9d-ad6d-56c1da7bb3a0,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:23.075816 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port cf24cf71-3d0f-4982-87dd-2a3f70f2b08e, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=cf24cf71-3d0f-4982-87dd-2a3f70f2b08e,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:32:23.087252 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-f1aa41de-f326-46a2-9c06-372c0a354c69 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=08941c965dbb41e59d17f27d6e643c13&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5544527 Dec 08 11:32:23.087722 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51322) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:23.103781 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:23.107996 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 00496e9d-a438-4edc-b803-98d3f6b8e626 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:23.244731 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=cf24cf71-3d0f-4982-87dd-2a3f70f2b08e,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:23.282076 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 00496e9d-a438-4edc-b803-98d3f6b8e626 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:23.285070 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:23.423982 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device f0d99c11-f976-4a6b-a95d-292a9bdeb5aa up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:23.559778 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port f0d99c11-f976-4a6b-a95d-292a9bdeb5aa triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:23.560158 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:23.674528 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-19244556-2b86-49b0-abb9-fe76a139e6a2 req-9d52f3f3-46e0-4b06-8bcd-c309d09fc786 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] For port 8e4b1127-3db2-4f93-a731-315192c060b3, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=8e4b1127-3db2-4f93-a731-315192c060b3,segment=NetworkSegment(5be28b76-0677-4ab9-a950-5242cff71605),segment_id=5be28b76-0677-4ab9-a950-5242cff71605)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:32:23.675533 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-19244556-2b86-49b0-abb9-fe76a139e6a2 req-9d52f3f3-46e0-4b06-8bcd-c309d09fc786 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:23.752540 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-19244556-2b86-49b0-abb9-fe76a139e6a2 req-9d52f3f3-46e0-4b06-8bcd-c309d09fc786 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Calling delete_port for 8e4b1127-3db2-4f93-a731-315192c060b3 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:32:23.769586 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-09b91218-9e64-4a17-8c19-601d73f1628e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:23.879279 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ea9aea5-7cd5-41ac-ba2d-24f4512d6aea req-a5c868be-741a-4135-af2d-ad35fc8af93f tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:23.881402 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ea9aea5-7cd5-41ac-ba2d-24f4512d6aea req-a5c868be-741a-4135-af2d-ad35fc8af93f tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 945 time: 0.1746721 Dec 08 11:32:23.905289 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-09b91218-9e64-4a17-8c19-601d73f1628e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:24.094159 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ea9aea5-7cd5-41ac-ba2d-24f4512d6aea req-49c6e890-316a-4380-bd60-021a80762bd3 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/security-groups?id=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2016656 Dec 08 11:32:24.118700 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-09b91218-9e64-4a17-8c19-601d73f1628e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:24.121995 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-09b91218-9e64-4a17-8c19-601d73f1628e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:24.123305 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-09b91218-9e64-4a17-8c19-601d73f1628e admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/e1e03bad-d41b-4e9d-ad6d-56c1da7bb3a0 HTTP/1.1" status: 204 len: 168 time: 1.0335495 Dec 08 11:32:24.204170 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09b91218-9e64-4a17-8c19-601d73f1628e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e1e03bad-d41b-4e9d-ad6d-56c1da7bb3a0,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:24.247598 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device cf24cf71-3d0f-4982-87dd-2a3f70f2b08e up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:24.249554 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a81c575f-416b-4906-9abc-4fab6a32912c req-9056dc77-b355-44a0-81f3-8222e4e45e6f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:24.258456 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a81c575f-416b-4906-9abc-4fab6a32912c req-9056dc77-b355-44a0-81f3-8222e4e45e6f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 946 time: 0.2844219 Dec 08 11:32:24.300763 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-19244556-2b86-49b0-abb9-fe76a139e6a2 req-9d52f3f3-46e0-4b06-8bcd-c309d09fc786 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:24.341248 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['8e4b1127-3db2-4f93-a731-315192c060b3'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:32:24.441317 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Sync routers for ids ['b92702ae-4c49-4f76-81b7-ca5150f7e9c2'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:32:24.454147 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d52f3f3-46e0-4b06-8bcd-c309d09fc786 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Pushing event deleted for resources: {'Port': ['ID=8e4b1127-3db2-4f93-a731-315192c060b3,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:24.465871 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Routers {'b92702ae-4c49-4f76-81b7-ca5150f7e9c2'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:32:24.467096 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:31:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['b92702ae-4c49-4f76-81b7-ca5150f7e9c2'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:24.487525 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-19244556-2b86-49b0-abb9-fe76a139e6a2 req-9d52f3f3-46e0-4b06-8bcd-c309d09fc786 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] No DVR routers for this DVR port 8e4b1127-3db2-4f93-a731-315192c060b3 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:32:24.492851 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-19244556-2b86-49b0-abb9-fe76a139e6a2 req-9d52f3f3-46e0-4b06-8bcd-c309d09fc786 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:24.500209 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-19244556-2b86-49b0-abb9-fe76a139e6a2 req-9d52f3f3-46e0-4b06-8bcd-c309d09fc786 tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.61 "DELETE /v2.0/ports/8e4b1127-3db2-4f93-a731-315192c060b3 HTTP/1.1" status: 204 len: 173 time: 1.6424870 Dec 08 11:32:24.532186 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a81c575f-416b-4906-9abc-4fab6a32912c req-8567bd12-67fe-425c-90f5-05e6c41452b4 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2725816 Dec 08 11:32:24.534995 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fe445662-9a2d-4c17-96ea-b054be927e53', 'name': 'network-vif-deleted', 'tag': '8e4b1127-3db2-4f93-a731-315192c060b3'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:32:24.538422 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d5333973-feed-4944-a365-c741fdacc820" -d '{"events": [{"server_uuid": "fe445662-9a2d-4c17-96ea-b054be927e53", "name": "network-vif-deleted", "tag": "8e4b1127-3db2-4f93-a731-315192c060b3"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:32:24.557576 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port cf24cf71-3d0f-4982-87dd-2a3f70f2b08e triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:24.558047 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:24.673316 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:32:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-669e9102-2916-4141-bc97-2bde8facb165 x-openstack-request-id: req-669e9102-2916-4141-bc97-2bde8facb165 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:32:24.673957 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fe445662-9a2d-4c17-96ea-b054be927e53", "name": "network-vif-deleted", "tag": "8e4b1127-3db2-4f93-a731-315192c060b3", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:32:24.674340 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-669e9102-2916-4141-bc97-2bde8facb165 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:32:24.674927 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fe445662-9a2d-4c17-96ea-b054be927e53', 'name': 'network-vif-deleted', 'tag': '8e4b1127-3db2-4f93-a731-315192c060b3', 'status': 'completed', 'code': 200} Dec 08 11:32:24.732079 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1ac8ae0c-e90f-48da-ab12-c024570a745c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:24.745456 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Set router b92702ae-4c49-4f76-81b7-ca5150f7e9c2 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:32:25.277671 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6a2ef69d-dbd8-4a73-9408-61e5c6d7e550 req-bd2b00fa-2dfb-497e-b54c-6cdc885c8eec tempest-DeleteServersTestJSON-891310354 tempest-DeleteServersTestJSON-891310354-project] 10.222.0.66 "GET /v2.0/ports?device_id=fe445662-9a2d-4c17-96ea-b054be927e53 HTTP/1.1" status: 200 len: 210 time: 0.0617981 Dec 08 11:32:25.358390 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'name': 'tempest-TestMinimumBasicScenario-2024163828-router', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61'}], 'enable_snat': True}, 'gw_port_id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:32:21Z', 'revision_number': 4, 'project_id': '768a297d7e694199b80b2fa7f4671866', 'gw_port': {'id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:09:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:32:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': 'a124b6f3-37e6-4602-830a-3285a1585a50', 'name': '', 'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'mac_address': 'fa:16:3e:4f:f3:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 291, 'fixed_ips': [{'subnet_id': '6ad3a8d0-0889-4cb7-801c-def529056ea9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:20Z', 'updated_at': '2021-12-08T11:32:21Z', 'revision_number': 2, 'project_id': '768a297d7e694199b80b2fa7f4671866', 'subnets': [{'id': '6ad3a8d0-0889-4cb7-801c-def529056ea9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:25.408447 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Checking router: b92702ae-4c49-4f76-81b7-ca5150f7e9c2 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:32:25.409395 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Updating router b92702ae-4c49-4f76-81b7-ca5150f7e9c2 port a124b6f3-37e6-4602-830a-3285a1585a50 binding host dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:32:25.478454 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:25.774997 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-243eb2b4-6e00-4b5c-bb41-5f98146ecc11 req-b870be1b-6ec4-43a6-9ce9-a036025ea8fb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:25.793998 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-243eb2b4-6e00-4b5c-bb41-5f98146ecc11 req-b870be1b-6ec4-43a6-9ce9-a036025ea8fb tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 946 time: 0.1590836 Dec 08 11:32:25.964517 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:25.975834 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-243eb2b4-6e00-4b5c-bb41-5f98146ecc11 req-4b338c6a-77e6-4d5e-b2f9-7afcc5ec33f3 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1787798 Dec 08 11:32:26.153526 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Publish callbacks [] for port, precommit_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:26.166181 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:26.224300 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c8dab9c-245e-4e23-812f-ddc3982d6885 None None] Pushing event updated for resources: {'Port': ['ID=a124b6f3-37e6-4602-830a-3285a1585a50,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:26.327052 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Attempting to bind port a124b6f3-37e6-4602-830a-3285a1585a50 on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:32:26.327516 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Attempting to bind port a124b6f3-37e6-4602-830a-3285a1585a50 by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '15bdd0ed-936d-41c5-b3bd-63dca39d9789', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:32:26.327890 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Attempting to bind port a124b6f3-37e6-4602-830a-3285a1585a50 on network 6a5ef37d-afdd-4d25-a278-64647e2c4759 {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:26.335648 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 51460) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:26.353002 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 31, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:32:26.353449 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Checking segment: {'id': '15bdd0ed-936d-41c5-b3bd-63dca39d9789', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:26.353841 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:26.354249 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Bound using segment: {'id': '15bdd0ed-936d-41c5-b3bd-63dca39d9789', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:32:26.354783 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Bound port: a124b6f3-37e6-4602-830a-3285a1585a50, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '15bdd0ed-936d-41c5-b3bd-63dca39d9789', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 263, 'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:32:26.355597 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:26.425025 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60f8dc83-9048-4776-83b4-b8cce7160591 req-72f7c031-7ced-4876-9ec6-97f3b4f0d1da tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:26.427368 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-60f8dc83-9048-4776-83b4-b8cce7160591 req-72f7c031-7ced-4876-9ec6-97f3b4f0d1da tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.61 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 946 time: 0.1028807 Dec 08 11:32:26.542948 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] For port a124b6f3-37e6-4602-830a-3285a1585a50, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:32:26.546582 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] For port a124b6f3-37e6-4602-830a-3285a1585a50, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=a124b6f3-37e6-4602-830a-3285a1585a50,segment=NetworkSegment(15bdd0ed-936d-41c5-b3bd-63dca39d9789),segment_id=15bdd0ed-936d-41c5-b3bd-63dca39d9789)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:32:26.552646 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:26.601598 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-60f8dc83-9048-4776-83b4-b8cce7160591 req-6ae845d4-5784-4aa3-bef1-e77cdda16f64 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Deleting port fdf2c7c1-363c-4a60-b59f-a320f77b0e66 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:32:26.602045 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-60f8dc83-9048-4776-83b4-b8cce7160591 req-6ae845d4-5784-4aa3-bef1-e77cdda16f64 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:26.746956 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c8dab9c-245e-4e23-812f-ddc3982d6885 None None] Pushing event updated for resources: {'Port': ['ID=a124b6f3-37e6-4602-830a-3285a1585a50,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:26.776189 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8934ed44-4772-4cf6-aed4-bfe012d5afb9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:26.782549 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 8e4b1127-3db2-4f93-a731-315192c060b3 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:32:26.818037 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-60f8dc83-9048-4776-83b4-b8cce7160591 req-6ae845d4-5784-4aa3-bef1-e77cdda16f64 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] For port fdf2c7c1-363c-4a60-b59f-a320f77b0e66, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=fdf2c7c1-363c-4a60-b59f-a320f77b0e66,segment=NetworkSegment(c37df7a5-94f5-4cf8-8161-23e912b124b9),segment_id=c37df7a5-94f5-4cf8-8161-23e912b124b9)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:32:26.819399 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-60f8dc83-9048-4776-83b4-b8cce7160591 req-6ae845d4-5784-4aa3-bef1-e77cdda16f64 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:26.851705 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 8e4b1127-3db2-4f93-a731-315192c060b3 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:32:26.852284 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 8e4b1127-3db2-4f93-a731-315192c060b3 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:32:26.853836 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Routers {'b92702ae-4c49-4f76-81b7-ca5150f7e9c2'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:32:26.854479 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:32:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['b92702ae-4c49-4f76-81b7-ca5150f7e9c2'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:26.855270 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-60f8dc83-9048-4776-83b4-b8cce7160591 req-6ae845d4-5784-4aa3-bef1-e77cdda16f64 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling delete_port for fdf2c7c1-363c-4a60-b59f-a320f77b0e66 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:32:26.862098 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-8db751c3-2704-4da3-85b2-93ce2d4bfa95 None None] Provisioning complete for port a124b6f3-37e6-4602-830a-3285a1585a50 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:26.862475 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-8db751c3-2704-4da3-85b2-93ce2d4bfa95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:27.051621 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8934ed44-4772-4cf6-aed4-bfe012d5afb9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:27.058710 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-60f8dc83-9048-4776-83b4-b8cce7160591 req-6ae845d4-5784-4aa3-bef1-e77cdda16f64 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:27.066563 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8934ed44-4772-4cf6-aed4-bfe012d5afb9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:27.115926 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['fdf2c7c1-363c-4a60-b59f-a320f77b0e66'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:32:27.144381 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ae845d4-5784-4aa3-bef1-e77cdda16f64 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Pushing event deleted for resources: {'Port': ['ID=fdf2c7c1-363c-4a60-b59f-a320f77b0e66,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:27.163823 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8934ed44-4772-4cf6-aed4-bfe012d5afb9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f0a2199-0704-46e7-b61b-85532a6fc2ed,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:27.184369 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-8934ed44-4772-4cf6-aed4-bfe012d5afb9 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=208777b80fae4ba98b3245292118ea9e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8460937 Dec 08 11:32:27.187255 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-60f8dc83-9048-4776-83b4-b8cce7160591 req-6ae845d4-5784-4aa3-bef1-e77cdda16f64 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] No DVR routers for this DVR port fdf2c7c1-363c-4a60-b59f-a320f77b0e66 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:32:27.189319 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 51484) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:27.191070 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-60f8dc83-9048-4776-83b4-b8cce7160591 req-6ae845d4-5784-4aa3-bef1-e77cdda16f64 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:27.195570 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-60f8dc83-9048-4776-83b4-b8cce7160591 req-6ae845d4-5784-4aa3-bef1-e77cdda16f64 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.61 "DELETE /v2.0/ports/fdf2c7c1-363c-4a60-b59f-a320f77b0e66 HTTP/1.1" status: 204 len: 173 time: 0.7583296 Dec 08 11:32:27.196514 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd60041b9-3a0a-495a-aaa8-0da5f57e7e42', 'name': 'network-vif-deleted', 'tag': 'fdf2c7c1-363c-4a60-b59f-a320f77b0e66'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:32:27.199868 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5d887361-ba10-47bc-9b53-2271a83bf849" -d '{"events": [{"server_uuid": "d60041b9-3a0a-495a-aaa8-0da5f57e7e42", "name": "network-vif-deleted", "tag": "fdf2c7c1-363c-4a60-b59f-a320f77b0e66"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:32:27.210722 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-8db751c3-2704-4da3-85b2-93ce2d4bfa95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:27.263998 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-8db751c3-2704-4da3-85b2-93ce2d4bfa95 None None] For port a124b6f3-37e6-4602-830a-3285a1585a50, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=a124b6f3-37e6-4602-830a-3285a1585a50,segment=NetworkSegment(15bdd0ed-936d-41c5-b3bd-63dca39d9789),segment_id=15bdd0ed-936d-41c5-b3bd-63dca39d9789)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:32:27.284308 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-8db751c3-2704-4da3-85b2-93ce2d4bfa95 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:27.292360 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c21bb058-6028-4759-95b1-dbac04212894 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:27.311799 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-763937bc-7f6d-4524-8dff-e7fdee2dfa00 req-ba6c458b-6b56-46f6-848d-74978092ff83 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=d60041b9-3a0a-495a-aaa8-0da5f57e7e42 HTTP/1.1" status: 200 len: 210 time: 0.0633900 Dec 08 11:32:27.328369 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:27.331032 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c21bb058-6028-4759-95b1-dbac04212894 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:27.373394 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] Set router b92702ae-4c49-4f76-81b7-ca5150f7e9c2 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:32:27.408769 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c21bb058-6028-4759-95b1-dbac04212894 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:27.414278 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c21bb058-6028-4759-95b1-dbac04212894 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:27.416611 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8db751c3-2704-4da3-85b2-93ce2d4bfa95 None None] Pushing event updated for resources: {'Port': ['ID=a124b6f3-37e6-4602-830a-3285a1585a50,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:27.417222 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-c21bb058-6028-4759-95b1-dbac04212894 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/1f0a2199-0704-46e7-b61b-85532a6fc2ed HTTP/1.1" status: 204 len: 168 time: 0.2223730 Dec 08 11:32:27.431423 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:32:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bb970da9-8471-4776-b269-cdd02114d49a x-openstack-request-id: req-bb970da9-8471-4776-b269-cdd02114d49a {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:32:27.431723 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d60041b9-3a0a-495a-aaa8-0da5f57e7e42", "name": "network-vif-deleted", "tag": "fdf2c7c1-363c-4a60-b59f-a320f77b0e66", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:32:27.431980 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-bb970da9-8471-4776-b269-cdd02114d49a {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:32:27.432378 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd60041b9-3a0a-495a-aaa8-0da5f57e7e42', 'name': 'network-vif-deleted', 'tag': 'fdf2c7c1-363c-4a60-b59f-a320f77b0e66', 'status': 'completed', 'code': 200} Dec 08 11:32:27.435020 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c21bb058-6028-4759-95b1-dbac04212894 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f0a2199-0704-46e7-b61b-85532a6fc2ed,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:27.438357 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-3724bff4-14a0-479a-8d45-fa38c3849143 None None] Provisioning complete for port a124b6f3-37e6-4602-830a-3285a1585a50 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:27.438737 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-3724bff4-14a0-479a-8d45-fa38c3849143 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:27.704453 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'name': 'tempest-TestMinimumBasicScenario-2024163828-router', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61'}], 'enable_snat': True}, 'gw_port_id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:32:21Z', 'revision_number': 4, 'project_id': '768a297d7e694199b80b2fa7f4671866', 'gw_port': {'id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:09:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:32:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': 'a124b6f3-37e6-4602-830a-3285a1585a50', 'name': '', 'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'mac_address': 'fa:16:3e:4f:f3:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 291, 'fixed_ips': [{'subnet_id': '6ad3a8d0-0889-4cb7-801c-def529056ea9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:20Z', 'updated_at': '2021-12-08T11:32:26Z', 'revision_number': 4, 'project_id': '768a297d7e694199b80b2fa7f4671866', 'subnets': [{'id': '6ad3a8d0-0889-4cb7-801c-def529056ea9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:27.738697 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d276b3af-d444-4898-a4b3-0f8c4e171afe None None] The sync data for ids ['b92702ae-4c49-4f76-81b7-ca5150f7e9c2'] in dv-cinder-819778-3-iscsi is: [{'id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'name': 'tempest-TestMinimumBasicScenario-2024163828-router', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61'}], 'enable_snat': True}, 'gw_port_id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:32:21Z', 'revision_number': 4, 'project_id': '768a297d7e694199b80b2fa7f4671866', 'gw_port': {'id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:09:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:32:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': 'a124b6f3-37e6-4602-830a-3285a1585a50', 'name': '', 'network_id': '6a5ef37d-afdd-4d25-a278-64647e2c4759', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'mac_address': 'fa:16:3e:4f:f3:69', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'device_owner': 'network:router_interface', 'standard_attr_id': 291, 'fixed_ips': [{'subnet_id': '6ad3a8d0-0889-4cb7-801c-def529056ea9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:20Z', 'updated_at': '2021-12-08T11:32:26Z', 'revision_number': 4, 'project_id': '768a297d7e694199b80b2fa7f4671866', 'subnets': [{'id': '6ad3a8d0-0889-4cb7-801c-def529056ea9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:32:28.184544 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:28.406837 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device a124b6f3-37e6-4602-830a-3285a1585a50 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:28.430674 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 51520) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:28.550392 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_v2 [None req-0b06ceb7-6c16-4e26-95a6-4b91cdcf425e admin admin] Deleting subnet 2d9f9ed3-4577-43a0-80bf-cc86dab7d362 {{(pid=102317) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:32:28.555163 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0b06ceb7-6c16-4e26-95a6-4b91cdcf425e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:28.571415 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port a124b6f3-37e6-4602-830a-3285a1585a50 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:28.571800 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:28.641265 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0b06ceb7-6c16-4e26-95a6-4b91cdcf425e admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:28.655606 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0b06ceb7-6c16-4e26-95a6-4b91cdcf425e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:28.774002 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0b06ceb7-6c16-4e26-95a6-4b91cdcf425e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for subnet, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:28.805728 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b06ceb7-6c16-4e26-95a6-4b91cdcf425e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2d9f9ed3-4577-43a0-80bf-cc86dab7d362,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:28.811223 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0b06ceb7-6c16-4e26-95a6-4b91cdcf425e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:28.814788 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-0b06ceb7-6c16-4e26-95a6-4b91cdcf425e admin admin] 10.222.0.66 "DELETE /v2.0/subnets/2d9f9ed3-4577-43a0-80bf-cc86dab7d362 HTTP/1.1" status: 204 len: 168 time: 0.3824077 Dec 08 11:32:28.817477 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51536) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:28.926935 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:29.024431 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:29.048529 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.049261 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.050209 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.050742 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > port after_create 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.051270 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.051674 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > port after_update 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.052662 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.053048 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.053449 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.053836 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.252301 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.252657 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.252997 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.253387 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102318) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:32:29.253761 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d0180d44-2173-43bc-b3b2-67db13c39ea0']}} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:29.272676 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5be28b76-0677-4ab9-a950-5242cff71605') {'for_net_delete': True} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:29.273050 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5be28b76-0677-4ab9-a950-5242cff71605') {} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:29.300495 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16370039'] for segment, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:29.327131 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:29.339325 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Releasing vlan 295 on physical network physnet1 to pool {{(pid=102318) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:32:29.340014 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4575654'] for segment, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: from cryptography.utils import int_from_bytes Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: from cryptography.utils import int_from_bytes Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: Traceback (most recent call last): Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: timer() Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: cb(*args, **kw) Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: return func(*args, **kwargs) Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: self._notify() Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: self.callback(batched_events) Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: event.method(event) Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: return f(self, *a, **k) Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._get(url).json() Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: return self.request(url, 'GET', **kwargs) Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:32:29.369439 dv-cinder-819778-3-iscsi neutron-server[102318]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:32:29.456783 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:29.464746 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:29.470671 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] 10.222.0.66 "DELETE /v2.0/networks/d0180d44-2173-43bc-b3b2-67db13c39ea0 HTTP/1.1" status: 204 len: 168 time: 0.6489427 Dec 08 11:32:29.478631 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d304c5a1-ba64-4aa0-8265-f48d4155c907 admin admin] Pushing event deleted for resources: {'Network': ['ID=d0180d44-2173-43bc-b3b2-67db13c39ea0,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:29.674069 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51552) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:29.728333 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-5eac76ad-0570-4b41-aa8b-2cffe75deb93 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=1770e8f8a0b34c0aa4adafccc2df6628&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0528615 Dec 08 11:32:29.731131 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51554) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:29.785167 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-23583264-568f-42d6-ace2-658ac01cb2db admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:29.807994 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-23583264-568f-42d6-ace2-658ac01cb2db admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:29.872331 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-23583264-568f-42d6-ace2-658ac01cb2db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:29.874998 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-23583264-568f-42d6-ace2-658ac01cb2db admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:29.876304 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-23583264-568f-42d6-ace2-658ac01cb2db admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8 HTTP/1.1" status: 204 len: 168 time: 0.1442068 Dec 08 11:32:29.887699 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23583264-568f-42d6-ace2-658ac01cb2db admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bfbd785f-0bc4-4e3f-ba13-956c8a6db4e8,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:30.728441 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 51578) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:30.803317 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device fdf2c7c1-363c-4a60-b59f-a320f77b0e66 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:32:30.829376 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: fdf2c7c1-363c-4a60-b59f-a320f77b0e66 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:32:30.829732 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device fdf2c7c1-363c-4a60-b59f-a320f77b0e66 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:32:30.853044 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1990879057-network', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:30.877999 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Made reservation on behalf of 801ccccb4d7647de8e9558e07ebdc070 for: {'network': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:32:30.880350 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:30.889484 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:30.977639 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:30.982725 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:31.008956 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] vlan segment allocate from pool success with {'vlan_id': 252, 'physical_network': 'physnet1'} {{(pid=102317) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:32:31.017907 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75bd5163-3e52-4a6c-84d2-db036e5fa483,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:31.025049 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:31.025423 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.segments_db [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Added segment aa890c2f-8ce4-49b3-a366-4788a314e043 of type vlan for network b799b290-99c1-4693-82cc-42bbd4d90adb Dec 08 11:32:31.071802 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:31.105099 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:31.106383 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:31.107083 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:31.165459 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 0.4358430 Dec 08 11:32:31.168609 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51582) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:31.174073 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-22780c13-b278-4932-b872-b3bf76101a04 admin admin] Request body: {'subnet': {'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1990879057-subnet', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:31.180032 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d6154e1-5239-4c68-98eb-516c735e4ce7 admin admin] Pushing event updated for resources: {'Network': ['ID=b799b290-99c1-4693-82cc-42bbd4d90adb,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:31.193739 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network b799b290-99c1-4693-82cc-42bbd4d90adb details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:32:31.219834 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-22780c13-b278-4932-b872-b3bf76101a04 admin admin] Made reservation on behalf of 801ccccb4d7647de8e9558e07ebdc070 for: {'subnet': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:32:31.222993 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-22780c13-b278-4932-b872-b3bf76101a04 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-16496611'] for subnet, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:31.447443 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-22780c13-b278-4932-b872-b3bf76101a04 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4572227', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-16496629'] for subnet, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:31.515131 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22780c13-b278-4932-b872-b3bf76101a04 admin admin] Pushing event updated for resources: {'Subnet': ['ID=59ab11c2-3db5-4069-afa6-b6f825d69316,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:31.521251 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22780c13-b278-4932-b872-b3bf76101a04 admin admin] Checking segment: {'id': 'aa890c2f-8ce4-49b3-a366-4788a314e043', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 252, 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:31.521678 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22780c13-b278-4932-b872-b3bf76101a04 admin admin] Network hostable DHCP agents. Network: b799b290-99c1-4693-82cc-42bbd4d90adb, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102318) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:32:31.539944 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22780c13-b278-4932-b872-b3bf76101a04 admin admin] Network b799b290-99c1-4693-82cc-42bbd4d90adb is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102318) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:32:31.550253 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-22780c13-b278-4932-b872-b3bf76101a04 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, b799b290-99c1-4693-82cc-42bbd4d90adb) {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:31.556290 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-22780c13-b278-4932-b872-b3bf76101a04 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:31.556895 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-22780c13-b278-4932-b872-b3bf76101a04 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:31.560497 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a489397c-aa7a-4d1c-b0ff-b063dea47efa None None] Network b799b290-99c1-4693-82cc-42bbd4d90adb requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:32:31.585012 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 51586) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:31.590186 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-22780c13-b278-4932-b872-b3bf76101a04 admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 0.4185026 Dec 08 11:32:31.592237 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1990879057-router', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:31.627158 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7895423', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32171'] for router, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:31.628327 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7895279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7889720', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7925360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32176'] for router, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:31.687791 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:31.696149 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-87a2266e-a89d-40c6-b5b7-1d9d20337a6b None None] Network b799b290-99c1-4693-82cc-42bbd4d90adb requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:32:31.842664 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:32.069776 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:32.095620 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:32.241324 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Allocated IP 172.27.2.72 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/778abdc6-77b1-45e0-88ad-ee39bfea6d21) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:32:32.414140 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:32.459532 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:32.497348 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:32.506527 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:32.510235 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:32:32.548169 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Pushing event updated for resources: {'Port': ['ID=778abdc6-77b1-45e0-88ad-ee39bfea6d21,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:32.752632 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:33.163409 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7895264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7889773'] for router, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:33.317843 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Router 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c is scheduled to L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f with binding_index 1 {{(pid=102317) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 08 11:32:33.447744 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:32:33.459747 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Sync routers for ids ['0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:32:33.471889 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Routers {'0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:32:33.472952 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:32:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:33.481193 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] Publish callbacks [] for router, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:33.482000 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-af03b941-7e34-46b6-941c-5e4ddf4697db admin admin] 10.222.0.66 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 1.8952065 Dec 08 11:32:33.484778 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 51596) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:33.589812 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Set router 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:32:33.793317 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'name': 'tempest-ServerRescueNegativeTestJSON-1990879057-router', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:31Z', 'updated_at': '2021-12-08T11:32:32Z', 'revision_number': 3, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'gw_port': {'id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:e4:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:32Z', 'updated_at': '2021-12-08T11:32:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:33.821911 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Checking router: 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:32:33.822929 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Updating router 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c port 778abdc6-77b1-45e0-88ad-ee39bfea6d21 binding host dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:32:33.850102 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:33.998601 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:34.190304 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Allocated IP 172.20.0.1 (b799b290-99c1-4693-82cc-42bbd4d90adb/59ab11c2-3db5-4069-afa6-b6f825d69316/56107fd6-be43-48a1-b2a0-e0180cab581a) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:32:34.190541 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Publish callbacks [] for port, precommit_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:34.203178 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:34.252558 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-788c40a0-7a34-4198-a223-c9d118bddb93 None None] Pushing event updated for resources: {'Port': ['ID=778abdc6-77b1-45e0-88ad-ee39bfea6d21,revision_number=2']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:34.276499 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Attempting to bind port 778abdc6-77b1-45e0-88ad-ee39bfea6d21 on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:32:34.276867 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Attempting to bind port 778abdc6-77b1-45e0-88ad-ee39bfea6d21 by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:32:34.277254 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Attempting to bind port 778abdc6-77b1-45e0-88ad-ee39bfea6d21 on network d7cb3021-649a-44ca-b3a1-005b3941164e {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:34.283153 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 32, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:32:34.283524 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Checking segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102320) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:34.283979 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:34.284376 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Bound using segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:32:34.285686 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Bound port: 778abdc6-77b1-45e0-88ad-ee39bfea6d21, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:32:34.286125 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:34.341018 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] For port 778abdc6-77b1-45e0-88ad-ee39bfea6d21, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102320) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:32:34.344135 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] For port 778abdc6-77b1-45e0-88ad-ee39bfea6d21, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=778abdc6-77b1-45e0-88ad-ee39bfea6d21,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102320) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:32:34.351008 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:34.351967 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:34.407302 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:34.436883 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-788c40a0-7a34-4198-a223-c9d118bddb93 None None] Pushing event updated for resources: {'Port': ['ID=778abdc6-77b1-45e0-88ad-ee39bfea6d21,revision_number=3']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:34.441769 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Routers {'0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:32:34.449217 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:32:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:34.456806 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Network b799b290-99c1-4693-82cc-42bbd4d90adb is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:34.459939 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:34.463520 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:32:34.530275 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Pushing event updated for resources: {'Port': ['ID=56107fd6-be43-48a1-b2a0-e0180cab581a,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:34.556483 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7898680'] for router_interface, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:34.590606 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] Set router 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:32:34.707633 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:34.797789 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'name': 'tempest-ServerRescueNegativeTestJSON-1990879057-router', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:31Z', 'updated_at': '2021-12-08T11:32:32Z', 'revision_number': 3, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'gw_port': {'id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:e4:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:32Z', 'updated_at': '2021-12-08T11:32:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:34.825804 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ff262e7-2b8d-4d77-a2b1-341c6db96e99 None None] The sync data for ids ['0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'] in dv-cinder-819778-3-iscsi is: [{'id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'name': 'tempest-ServerRescueNegativeTestJSON-1990879057-router', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:31Z', 'updated_at': '2021-12-08T11:32:32Z', 'revision_number': 3, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'gw_port': {'id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:e4:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:32Z', 'updated_at': '2021-12-08T11:32:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:32:34.938923 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:34.947987 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:35.024158 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Pushing event updated for resources: {'Port': ['ID=56107fd6-be43-48a1-b2a0-e0180cab581a,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:35.026814 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8074899', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7897000'] for router_interface, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:35.548561 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Network b799b290-99c1-4693-82cc-42bbd4d90adb is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:35.551178 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:35.713852 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Router 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:32:35.877248 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:32:35.884022 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-c2dea224-89b7-4b2b-8ce3-3518b6459943 admin admin] 10.222.0.66 "PUT /v2.0/routers/0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3979244 Dec 08 11:32:36.254352 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 778abdc6-77b1-45e0-88ad-ee39bfea6d21 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:36.306602 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 778abdc6-77b1-45e0-88ad-ee39bfea6d21 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:36.306979 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:36.390811 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:36.412889 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port 778abdc6-77b1-45e0-88ad-ee39bfea6d21, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=778abdc6-77b1-45e0-88ad-ee39bfea6d21,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:32:36.419010 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:36.474608 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=778abdc6-77b1-45e0-88ad-ee39bfea6d21,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:36.534789 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-231150ab-705f-4da3-8a08-a39716f469ef tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:36.536838 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-231150ab-705f-4da3-8a08-a39716f469ef tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/networks?id=6e4bda07-1ae1-4be4-bf28-e94211f51919 HTTP/1.1" status: 200 len: 813 time: 0.1759629 Dec 08 11:32:36.563421 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-a6bae780-92b3-4101-91fd-653ca00bf918 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:36.564920 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-a6bae780-92b3-4101-91fd-653ca00bf918 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/networks?id=1056c468-8569-46d3-ae01-3e9a87553272 HTTP/1.1" status: 200 len: 809 time: 0.2054014 Dec 08 11:32:36.566443 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3695fd88-a742-4537-ac80-c940776d4be4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/quotas/34e91fcdeaf64d10965b2770cbeab690 HTTP/1.1" status: 200 len: 375 time: 0.0205855 Dec 08 11:32:36.594578 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-7bf3fece-9175-468b-8e77-e41eae91c1cd tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/quotas/bde1d456ccb0411eaed7cb4c5c07de7d HTTP/1.1" status: 200 len: 375 time: 0.0204146 Dec 08 11:32:36.642483 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-a5562825-774e-4f04-bdb9-c0fc20e337a0 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=bde1d456ccb0411eaed7cb4c5c07de7d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0300031 Dec 08 11:32:36.663762 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-b2ad70ff-c172-43df-967d-ad5f9bf76dce tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0883634 Dec 08 11:32:36.818677 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-a7f9cf0c-8e71-4ecf-a72f-3509e0c59162 service neutron] 10.222.0.66 "GET /v2.0/networks/1056c468-8569-46d3-ae01-3e9a87553272?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1680598 Dec 08 11:32:36.824032 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-35ecc914-5308-4d14-a3c0-89e31cd4457b service neutron] 10.222.0.66 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1500862 Dec 08 11:32:36.965978 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Sync routers for ids ['0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:32:36.977455 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Routers {'0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:32:36.978341 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:32:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:36.985285 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-e588f1da-951f-4da4-920b-6884d6761c7a service neutron] 10.222.0.66 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1509590 Dec 08 11:32:36.987215 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-f2964eac-28a4-4575-8c97-0b4c7bb0c3b1 service neutron] 10.222.0.66 "GET /v2.0/networks/1056c468-8569-46d3-ae01-3e9a87553272?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1611793 Dec 08 11:32:37.321615 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Set router 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:32:37.664860 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'name': 'tempest-ServerRescueNegativeTestJSON-1990879057-router', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:31Z', 'updated_at': '2021-12-08T11:32:34Z', 'revision_number': 4, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'gw_port': {'id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:e4:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:32Z', 'updated_at': '2021-12-08T11:32:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '56107fd6-be43-48a1-b2a0-e0180cab581a', 'name': '', 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'mac_address': 'fa:16:3e:f4:8b:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '59ab11c2-3db5-4069-afa6-b6f825d69316', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:34Z', 'updated_at': '2021-12-08T11:32:34Z', 'revision_number': 2, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'subnets': [{'id': '59ab11c2-3db5-4069-afa6-b6f825d69316', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:37.741169 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-71e874ef-b265-4ea7-b62a-283b2b35ea27 req-352dec93-e329-40ea-9549-0b81371a1253 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 210 time: 0.0690670 Dec 08 11:32:37.748716 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Checking router: 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:32:37.749074 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Updating router 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c port 56107fd6-be43-48a1-b2a0-e0180cab581a binding host dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:32:37.783993 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:37.849427 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-ca040445-a760-4c3b-b55f-7c749e775f5f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:37.853649 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-ca040445-a760-4c3b-b55f-7c749e775f5f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/networks?id=b799b290-99c1-4693-82cc-42bbd4d90adb HTTP/1.1" status: 200 len: 819 time: 0.2125983 Dec 08 11:32:37.891152 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2072a5fe-4616-43b9-9044-a8f6bab53dc1 req-47a4583d-398c-4d56-acaa-d38e7f938d91 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 210 time: 0.0364647 Dec 08 11:32:37.892770 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-a39dc9b8-c8cc-4210-af88-a44a3061a1ed tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/quotas/801ccccb4d7647de8e9558e07ebdc070 HTTP/1.1" status: 200 len: 375 time: 0.0246735 Dec 08 11:32:37.993027 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-c12a3812-f9b0-435b-a8e6-1c959dbb86ae tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=801ccccb4d7647de8e9558e07ebdc070&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0930355 Dec 08 11:32:38.135103 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Publish callbacks [] for port, precommit_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:38.140514 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:38.158552 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-1fe2e0ca-c3f5-4125-8d21-c7498624d87c service neutron] 10.222.0.66 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1544845 Dec 08 11:32:38.167136 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-4f7486b9-f6e5-4922-8944-d98d9e3e1cff tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:38.168516 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-4f7486b9-f6e5-4922-8944-d98d9e3e1cff tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/networks?id=f5a54297-6b64-4f71-b9f2-2f9c14a03187 HTTP/1.1" status: 200 len: 814 time: 0.1817448 Dec 08 11:32:38.201322 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-175dc825-6a68-450e-917d-ad91582ce43a None None] Pushing event updated for resources: {'Port': ['ID=56107fd6-be43-48a1-b2a0-e0180cab581a,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:38.240564 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-de68e6e2-4fcd-4443-ada7-62dfde35eda1 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/quotas/3102b9c0f7ea45048750ae3c81085631 HTTP/1.1" status: 200 len: 375 time: 0.0290737 Dec 08 11:32:38.246029 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 778abdc6-77b1-45e0-88ad-ee39bfea6d21 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:38.278410 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Attempting to bind port 56107fd6-be43-48a1-b2a0-e0180cab581a on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:32:38.278774 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Attempting to bind port 56107fd6-be43-48a1-b2a0-e0180cab581a by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'aa890c2f-8ce4-49b3-a366-4788a314e043', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 252, 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:32:38.279136 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Attempting to bind port 56107fd6-be43-48a1-b2a0-e0180cab581a on network b799b290-99c1-4693-82cc-42bbd4d90adb {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:38.295470 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 32, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:32:38.295844 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Checking segment: {'id': 'aa890c2f-8ce4-49b3-a366-4788a314e043', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 252, 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:38.296241 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:38.296635 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Bound using segment: {'id': 'aa890c2f-8ce4-49b3-a366-4788a314e043', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 252, 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:32:38.297115 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Bound port: 56107fd6-be43-48a1-b2a0-e0180cab581a, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aa890c2f-8ce4-49b3-a366-4788a314e043', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 252, 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:32:38.297521 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:38.305519 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-17bb9043-322b-4919-b4f7-343cbd3f4e7e service neutron] 10.222.0.66 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1360462 Dec 08 11:32:38.315441 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-154a22a9-ffe0-4f27-977b-5887f97f81b2 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=3102b9c0f7ea45048750ae3c81085631&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0684128 Dec 08 11:32:38.364908 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 778abdc6-77b1-45e0-88ad-ee39bfea6d21 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:38.365471 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:38.408029 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] For port 56107fd6-be43-48a1-b2a0-e0180cab581a, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:32:38.414321 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] For port 56107fd6-be43-48a1-b2a0-e0180cab581a, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=56107fd6-be43-48a1-b2a0-e0180cab581a,segment=NetworkSegment(aa890c2f-8ce4-49b3-a366-4788a314e043),segment_id=aa890c2f-8ce4-49b3-a366-4788a314e043)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:32:38.435107 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:38.568253 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Routers {'0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:32:38.568881 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:32:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:38.606334 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-ebcda5e5-f10b-42b2-8263-48d65e8cda9f service neutron] 10.222.0.66 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2750101 Dec 08 11:32:38.625748 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-175dc825-6a68-450e-917d-ad91582ce43a None None] Pushing event updated for resources: {'Port': ['ID=56107fd6-be43-48a1-b2a0-e0180cab581a,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:38.737271 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-b606cc42-580f-46df-a5db-14768e34e465 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:38.740233 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-b606cc42-580f-46df-a5db-14768e34e465 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "GET /v2.0/networks?id=6e4bda07-1ae1-4be4-bf28-e94211f51919 HTTP/1.1" status: 200 len: 813 time: 0.2895939 Dec 08 11:32:38.765484 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-aba37615-d8f0-4f11-b670-4d29e95045e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Request body: {'port': {'device_id': '96e47acb-aeed-4636-9a70-a1b987abaed6', 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919', 'admin_state_up': True, 'tenant_id': '34e91fcdeaf64d10965b2770cbeab690'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:38.773185 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] Set router 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:32:38.877253 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c36c091b-e270-4910-9e42-6d3bac66e54e req-17da5eec-4363-42c4-997e-62e3fffe72b0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 210 time: 0.0508676 Dec 08 11:32:38.906740 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-8da0166f-6197-43f1-8cc2-227a81e91b0b service neutron] 10.222.0.66 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2883251 Dec 08 11:32:39.101644 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-31d9eae5-25f6-4deb-a36d-1ed39d3e69e9 req-028bd029-141c-45bd-8341-e2b7ba7ae09e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 210 time: 0.0547068 Dec 08 11:32:39.105601 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-aba37615-d8f0-4f11-b670-4d29e95045e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Made reservation on behalf of 34e91fcdeaf64d10965b2770cbeab690 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:32:39.109946 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-aba37615-d8f0-4f11-b670-4d29e95045e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:39.194233 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'name': 'tempest-ServerRescueNegativeTestJSON-1990879057-router', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:31Z', 'updated_at': '2021-12-08T11:32:34Z', 'revision_number': 4, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'gw_port': {'id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:e4:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:32Z', 'updated_at': '2021-12-08T11:32:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '56107fd6-be43-48a1-b2a0-e0180cab581a', 'name': '', 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'mac_address': 'fa:16:3e:f4:8b:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '59ab11c2-3db5-4069-afa6-b6f825d69316', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:34Z', 'updated_at': '2021-12-08T11:32:38Z', 'revision_number': 4, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'subnets': [{'id': '59ab11c2-3db5-4069-afa6-b6f825d69316', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:32:39.237035 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-0f633195-cb8c-45b9-b1b2-184e5d56cd39 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:39.239470 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5f0906b-8f0b-4fe7-94f2-14181f2d30d0 None None] The sync data for ids ['0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'] in dv-cinder-819778-3-iscsi is: [{'id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'name': 'tempest-ServerRescueNegativeTestJSON-1990879057-router', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:31Z', 'updated_at': '2021-12-08T11:32:34Z', 'revision_number': 4, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'gw_port': {'id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:e4:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:32Z', 'updated_at': '2021-12-08T11:32:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '56107fd6-be43-48a1-b2a0-e0180cab581a', 'name': '', 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'mac_address': 'fa:16:3e:f4:8b:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'device_owner': 'network:router_interface', 'standard_attr_id': 317, 'fixed_ips': [{'subnet_id': '59ab11c2-3db5-4069-afa6-b6f825d69316', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:34Z', 'updated_at': '2021-12-08T11:32:38Z', 'revision_number': 4, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'subnets': [{'id': '59ab11c2-3db5-4069-afa6-b6f825d69316', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:32:39.239934 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-0f633195-cb8c-45b9-b1b2-184e5d56cd39 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.61 "GET /v2.0/networks?id=1056c468-8569-46d3-ae01-3e9a87553272 HTTP/1.1" status: 200 len: 809 time: 0.2995493 Dec 08 11:32:39.380754 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-34a92e38-d11b-4acb-810c-f1365d8b7b51 req-f4ebe1e7-b624-43a4-9c24-8a674f45d13d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 210 time: 0.1221135 Dec 08 11:32:39.398524 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-f83cd72f-5d3c-4354-8518-5e5d09963305 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Request body: {'port': {'device_id': '3c255cd4-9751-4e4f-883b-9399d6a8c37e', 'network_id': '1056c468-8569-46d3-ae01-3e9a87553272', 'admin_state_up': True, 'tenant_id': 'bde1d456ccb0411eaed7cb4c5c07de7d'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:39.542020 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7ea43af8-5e7b-4501-86b1-0160c85277e4 req-a105b357-715d-4d2d-844b-53ef40342023 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 210 time: 0.0766671 Dec 08 11:32:39.570928 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-aba37615-d8f0-4f11-b670-4d29e95045e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Allocated IP 172.20.0.6 (6e4bda07-1ae1-4be4-bf28-e94211f51919/d6b1fb0e-d38f-47ca-a647-53b824c47e76/1d5f08a0-9b25-48d8-a2ed-88647aec1670) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:32:39.607875 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-f83cd72f-5d3c-4354-8518-5e5d09963305 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Made reservation on behalf of bde1d456ccb0411eaed7cb4c5c07de7d for: {'port': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:32:39.615926 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-f83cd72f-5d3c-4354-8518-5e5d09963305 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:39.631850 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-71de4f84-8679-4020-b66e-a71aab3c341e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:39.641063 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-71de4f84-8679-4020-b66e-a71aab3c341e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/networks?id=b799b290-99c1-4693-82cc-42bbd4d90adb HTTP/1.1" status: 200 len: 819 time: 0.3279736 Dec 08 11:32:39.672257 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-1bfad4db-46f2-45e8-a3cd-b50914175719 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/quotas/801ccccb4d7647de8e9558e07ebdc070 HTTP/1.1" status: 200 len: 375 time: 0.0302248 Dec 08 11:32:39.877876 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-f83cd72f-5d3c-4354-8518-5e5d09963305 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Allocated IP 172.20.0.6 (1056c468-8569-46d3-ae01-3e9a87553272/a2e78872-9414-489f-b73b-b06f4460aa93/6487232e-a2f6-40ee-bcd9-a49395653c34) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:32:40.077788 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-f83cd72f-5d3c-4354-8518-5e5d09963305 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:40.126527 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-f83cd72f-5d3c-4354-8518-5e5d09963305 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:40.141937 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-aba37615-d8f0-4f11-b670-4d29e95045e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:40.186170 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-aba37615-d8f0-4f11-b670-4d29e95045e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:40.198924 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['d9ecab87-157e-4ccb-8423-2248bb8451ea'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:32:40.329131 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f83cd72f-5d3c-4354-8518-5e5d09963305 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Pushing event updated for resources: {'Port': ['ID=6487232e-a2f6-40ee-bcd9-a49395653c34,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:40.332218 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 56107fd6-be43-48a1-b2a0-e0180cab581a up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:40.333474 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-f83cd72f-5d3c-4354-8518-5e5d09963305 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Network 1056c468-8569-46d3-ae01-3e9a87553272 is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:40.340422 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-f83cd72f-5d3c-4354-8518-5e5d09963305 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:40.348025 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-f83cd72f-5d3c-4354-8518-5e5d09963305 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:32:40.354872 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-f83cd72f-5d3c-4354-8518-5e5d09963305 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:40.355687 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-f83cd72f-5d3c-4354-8518-5e5d09963305 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:40.357775 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aba37615-d8f0-4f11-b670-4d29e95045e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Pushing event updated for resources: {'Port': ['ID=1d5f08a0-9b25-48d8-a2ed-88647aec1670,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:40.380730 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-f83cd72f-5d3c-4354-8518-5e5d09963305 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9863987 Dec 08 11:32:40.388258 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-0b7c52d4-4fba-4280-a126-fc24f5e50638 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=801ccccb4d7647de8e9558e07ebdc070&fields=id HTTP/1.1" status: 200 len: 255 time: 0.7146263 Dec 08 11:32:40.412422 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Request body: {'port': {'device_id': '3c255cd4-9751-4e4f-883b-9399d6a8c37e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:40.448950 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-aba37615-d8f0-4f11-b670-4d29e95045e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Network 6e4bda07-1ae1-4be4-bf28-e94211f51919 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:40.463882 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 56107fd6-be43-48a1-b2a0-e0180cab581a triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:40.464317 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:40.499120 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:40.565174 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:40.572789 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-aba37615-d8f0-4f11-b670-4d29e95045e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:40.606425 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-aba37615-d8f0-4f11-b670-4d29e95045e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:32:40.625762 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port 56107fd6-be43-48a1-b2a0-e0180cab581a, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=56107fd6-be43-48a1-b2a0-e0180cab581a,segment=NetworkSegment(aa890c2f-8ce4-49b3-a366-4788a314e043),segment_id=aa890c2f-8ce4-49b3-a366-4788a314e043)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:32:40.634247 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:40.694252 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=56107fd6-be43-48a1-b2a0-e0180cab581a,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:40.733558 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-e77d4f5c-7da8-40d7-8c26-11569c6158b4 service neutron] 10.222.0.66 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3440804 Dec 08 11:32:40.753713 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aefc658-d966-4e66-a21f-6d7d714d8b1e req-49332668-ac32-4b97-90dc-33a379695854 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:40.755496 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2aefc658-d966-4e66-a21f-6d7d714d8b1e req-49332668-ac32-4b97-90dc-33a379695854 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 931 time: 0.4829192 Dec 08 11:32:40.792149 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-aba37615-d8f0-4f11-b670-4d29e95045e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:40.792760 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-aba37615-d8f0-4f11-b670-4d29e95045e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:40.843439 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-fa62dfe8-8096-44ff-9016-b449191bf78d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:40.847834 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-fa62dfe8-8096-44ff-9016-b449191bf78d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.61 "GET /v2.0/networks?id=b799b290-99c1-4693-82cc-42bbd4d90adb HTTP/1.1" status: 200 len: 819 time: 0.3958020 Dec 08 11:32:40.857284 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.notifiers.nova [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6487232e-a2f6-40ee-bcd9-a49395653c34 {{(pid=102317) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:32:40.865852 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:40.881520 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.provisioning_blocks [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Transition to ACTIVE for port object 6487232e-a2f6-40ee-bcd9-a49395653c34 will not be triggered until provisioned by entity L2. {{(pid=102317) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:32:40.887478 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:40.889622 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-2216b228-5926-45da-aa6d-2ccab191ebaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Request body: {'port': {'device_id': 'ef74eb6c-4764-40c3-8610-e4f4bc3e610d', 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb', 'admin_state_up': True, 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:40.903107 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.61', 56898) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:32:40.989559 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2aefc658-d966-4e66-a21f-6d7d714d8b1e req-8cb87ea7-6398-463f-b8fd-89fb944fa5d1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2204096 Dec 08 11:32:41.000659 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-aba37615-d8f0-4f11-b670-4d29e95045e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2422535 Dec 08 11:32:41.032849 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Request body: {'port': {'device_id': '96e47acb-aeed-4636-9a70-a1b987abaed6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:41.146296 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Pushing event updated for resources: {'Port': ['ID=6487232e-a2f6-40ee-bcd9-a49395653c34,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:41.160754 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-2f4b8c46-60ab-41a1-844e-e5d6b238acda service neutron] 10.222.0.66 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4172471 Dec 08 11:32:41.171334 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-66fd96ef-caa5-4c3f-ad39-914a8f9e2708 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:41.180449 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-66fd96ef-caa5-4c3f-ad39-914a8f9e2708 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.61 "GET /v2.0/networks?id=f5a54297-6b64-4f71-b9f2-2f9c14a03187 HTTP/1.1" status: 200 len: 814 time: 0.2689459 Dec 08 11:32:41.192775 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.managers [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Attempting to bind port 6487232e-a2f6-40ee-bcd9-a49395653c34 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:32:41.193120 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.managers [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Attempting to bind port 6487232e-a2f6-40ee-bcd9-a49395653c34 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': 'c37df7a5-94f5-4cf8-8161-23e912b124b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '1056c468-8569-46d3-ae01-3e9a87553272'}] {{(pid=102317) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:32:41.193483 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Attempting to bind port 6487232e-a2f6-40ee-bcd9-a49395653c34 on network 1056c468-8569-46d3-ae01-3e9a87553272 {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:41.204800 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-d6377c73-fc69-4a3c-93eb-1532e05dd190 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Request body: {'port': {'device_id': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'admin_state_up': True, 'tenant_id': '3102b9c0f7ea45048750ae3c81085631'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:32:41.207222 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:41.211257 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Port 6487232e-a2f6-40ee-bcd9-a49395653c34 on network 1056c468-8569-46d3-ae01-3e9a87553272 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:32:41.211414 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Attempting to bind port 6487232e-a2f6-40ee-bcd9-a49395653c34 on network 1056c468-8569-46d3-ae01-3e9a87553272 {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:41.242178 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-2216b228-5926-45da-aa6d-2ccab191ebaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Made reservation on behalf of 801ccccb4d7647de8e9558e07ebdc070 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:32:41.247972 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-2216b228-5926-45da-aa6d-2ccab191ebaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:41.251625 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 32, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:32:41.251966 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Checking segment: {'id': 'c37df7a5-94f5-4cf8-8161-23e912b124b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '1056c468-8569-46d3-ae01-3e9a87553272'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:41.252443 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Bound using segment: {'id': 'c37df7a5-94f5-4cf8-8161-23e912b124b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '1056c468-8569-46d3-ae01-3e9a87553272'} {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:32:41.252793 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.managers [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Bound port: 6487232e-a2f6-40ee-bcd9-a49395653c34, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c37df7a5-94f5-4cf8-8161-23e912b124b9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 291, 'network_id': '1056c468-8569-46d3-ae01-3e9a87553272'}}] {{(pid=102317) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:32:41.253140 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:41.295771 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ddbec2e-3288-4090-abcb-57e4e789a449 req-92267053-3dfe-4d20-bcd1-e8e343be99a2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:41.298040 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3ddbec2e-3288-4090-abcb-57e4e789a449 req-92267053-3dfe-4d20-bcd1-e8e343be99a2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 943 time: 0.1967072 Dec 08 11:32:41.390656 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] For port 6487232e-a2f6-40ee-bcd9-a49395653c34, host hv-cinder-81977, cleared binding levels {{(pid=102317) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:32:41.396475 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] For port 6487232e-a2f6-40ee-bcd9-a49395653c34, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=6487232e-a2f6-40ee-bcd9-a49395653c34,segment=NetworkSegment(c37df7a5-94f5-4cf8-8161-23e912b124b9),segment_id=c37df7a5-94f5-4cf8-8161-23e912b124b9)] {{(pid=102317) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:32:41.400981 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:41.457088 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:41.457767 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:41.459295 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] 10.222.0.61 "PUT /v2.0/ports/6487232e-a2f6-40ee-bcd9-a49395653c34 HTTP/1.1" status: 200 len: 1093 time: 1.0535870 Dec 08 11:32:41.459874 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-d6377c73-fc69-4a3c-93eb-1532e05dd190 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Made reservation on behalf of 3102b9c0f7ea45048750ae3c81085631 for: {'port': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:32:41.463572 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-d6377c73-fc69-4a3c-93eb-1532e05dd190 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:41.465517 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3c255cd4-9751-4e4f-883b-9399d6a8c37e', 'tag': '6487232e-a2f6-40ee-bcd9-a49395653c34'}] {{(pid=102317) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:32:41.468059 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}212dae370a2b559de5b7d578af79073c1e0f4cb02126db35c6693ef88f95633e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-961e1513-908e-41ce-9c49-4da90b3d6ebe" -d '{"events": [{"name": "network-changed", "server_uuid": "3c255cd4-9751-4e4f-883b-9399d6a8c37e", "tag": "6487232e-a2f6-40ee-bcd9-a49395653c34"}]}' {{(pid=102317) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:32:41.490713 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-91cc82de-92d5-4945-bf0f-8972672795d7 req-0dd96024-5de9-4121-81c9-9aa88eba8845 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 210 time: 0.0696580 Dec 08 11:32:41.507224 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ea3847d-0c5a-4086-907e-63873ef9ac37 service neutron] Pushing event updated for resources: {'Port': ['ID=6487232e-a2f6-40ee-bcd9-a49395653c34,revision_number=3']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:41.549135 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3ddbec2e-3288-4090-abcb-57e4e789a449 req-ef2be0f4-f2de-45c4-93a3-5e2116ec5938 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2377491 Dec 08 11:32:41.631114 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-a3fabb23-070e-43b7-b48a-47676ce2090f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:41.632662 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-a3fabb23-070e-43b7-b48a-47676ce2090f service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=bde1d456ccb0411eaed7cb4c5c07de7d&device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 1096 time: 0.1113892 Dec 08 11:32:41.716646 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-b16c8924-a179-4a9e-a886-b959174c4b4b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6487232e-a2f6-40ee-bcd9-a49395653c34 HTTP/1.1" status: 200 len: 217 time: 0.0487821 Dec 08 11:32:41.779811 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-d6377c73-fc69-4a3c-93eb-1532e05dd190 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Allocated IP 172.20.0.12 (f5a54297-6b64-4f71-b9f2-2f9c14a03187/07f39602-a4ed-4df9-a6e2-9c0943b66135/7fe8b63d-f6cd-45dc-a53c-93b64cacfeec) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:32:41.797236 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-39fa4a3b-ba36-4436-8930-66826c7ba4d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:41.804453 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-39fa4a3b-ba36-4436-8930-66826c7ba4d1 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=a2e78872-9414-489f-b73b-b06f4460aa93 HTTP/1.1" status: 200 len: 849 time: 0.0776114 Dec 08 11:32:41.841796 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b56f2724-428d-4771-9eb5-87f15658188c req-8d8cec09-8e96-46ae-bcc2-5e5cd7d56a4e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 210 time: 0.1042745 Dec 08 11:32:41.883863 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-2216b228-5926-45da-aa6d-2ccab191ebaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Allocated IP 172.20.0.8 (b799b290-99c1-4693-82cc-42bbd4d90adb/59ab11c2-3db5-4069-afa6-b6f825d69316/96b6dc81-7654-48f5-ac3f-e3e4d35982b3) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:32:42.007025 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1d5f08a0-9b25-48d8-a2ed-88647aec1670 {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:32:42.066043 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:42.067111 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:32:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-913bf354-d50f-4566-a67d-20b32703400f x-openstack-request-id: req-913bf354-d50f-4566-a67d-20b32703400f {{(pid=102317) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:32:42.072735 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3c255cd4-9751-4e4f-883b-9399d6a8c37e", "tag": "6487232e-a2f6-40ee-bcd9-a49395653c34", "status": "completed", "code": 200}]} {{(pid=102317) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:32:42.073327 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-913bf354-d50f-4566-a67d-20b32703400f {{(pid=102317) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:32:42.075424 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3c255cd4-9751-4e4f-883b-9399d6a8c37e', 'tag': '6487232e-a2f6-40ee-bcd9-a49395653c34', 'status': 'completed', 'code': 200} Dec 08 11:32:42.132906 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Transition to ACTIVE for port object 1d5f08a0-9b25-48d8-a2ed-88647aec1670 will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:32:42.148624 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-69036033-7d22-4898-bf95-2dd3713fe3c4 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=1056c468-8569-46d3-ae01-3e9a87553272&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.3291655 Dec 08 11:32:42.162366 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:42.215077 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-d6377c73-fc69-4a3c-93eb-1532e05dd190 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:42.280382 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-d6377c73-fc69-4a3c-93eb-1532e05dd190 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:42.311801 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 56107fd6-be43-48a1-b2a0-e0180cab581a up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:32:42.376832 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-2216b228-5926-45da-aa6d-2ccab191ebaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:42.381002 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 56107fd6-be43-48a1-b2a0-e0180cab581a triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:42.381525 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:42.406751 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-d6377c73-fc69-4a3c-93eb-1532e05dd190 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Network f5a54297-6b64-4f71-b9f2-2f9c14a03187 is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:42.411506 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-d6377c73-fc69-4a3c-93eb-1532e05dd190 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:42.427984 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d08d2b-8a68-410c-a99f-08d0f47e646a req-c2f7085c-6de0-4bf6-b8e9-7f5cbcaf5cfc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:42.431204 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-d6377c73-fc69-4a3c-93eb-1532e05dd190 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:32:42.435555 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a1d08d2b-8a68-410c-a99f-08d0f47e646a req-c2f7085c-6de0-4bf6-b8e9-7f5cbcaf5cfc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 943 time: 0.2954829 Dec 08 11:32:42.451496 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-d6377c73-fc69-4a3c-93eb-1532e05dd190 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:42.452223 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-d6377c73-fc69-4a3c-93eb-1532e05dd190 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:42.452739 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Pushing event updated for resources: {'Port': ['ID=1d5f08a0-9b25-48d8-a2ed-88647aec1670,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:42.475009 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6377c73-fc69-4a3c-93eb-1532e05dd190 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event updated for resources: {'Port': ['ID=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:42.500993 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-d6377c73-fc69-4a3c-93eb-1532e05dd190 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3018668 Dec 08 11:32:42.582535 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-2216b228-5926-45da-aa6d-2ccab191ebaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:42.600318 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a1d08d2b-8a68-410c-a99f-08d0f47e646a req-a38fa253-cc0a-4088-8cea-82832ae9edf1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1637654 Dec 08 11:32:42.727958 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Attempting to bind port 1d5f08a0-9b25-48d8-a2ed-88647aec1670 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:32:42.728556 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Attempting to bind port 1d5f08a0-9b25-48d8-a2ed-88647aec1670 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:32:42.728890 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Attempting to bind port 1d5f08a0-9b25-48d8-a2ed-88647aec1670 on network 6e4bda07-1ae1-4be4-bf28-e94211f51919 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:42.749184 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-2216b228-5926-45da-aa6d-2ccab191ebaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Network b799b290-99c1-4693-82cc-42bbd4d90adb is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:32:42.756857 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Port 1d5f08a0-9b25-48d8-a2ed-88647aec1670 on network 6e4bda07-1ae1-4be4-bf28-e94211f51919 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:32:42.757210 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Attempting to bind port 1d5f08a0-9b25-48d8-a2ed-88647aec1670 on network 6e4bda07-1ae1-4be4-bf28-e94211f51919 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:32:42.761341 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-2216b228-5926-45da-aa6d-2ccab191ebaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:32:42.765011 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2216b228-5926-45da-aa6d-2ccab191ebaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Pushing event updated for resources: {'Port': ['ID=96b6dc81-7654-48f5-ac3f-e3e4d35982b3,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:42.769680 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-2216b228-5926-45da-aa6d-2ccab191ebaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:32:42.796960 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 32, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:32:42.797358 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Checking segment: {'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:32:42.797763 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Bound using segment: {'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:32:42.798257 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Bound port: 1d5f08a0-9b25-48d8-a2ed-88647aec1670, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:32:42.798653 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:42.824958 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-b8785bc3-ff71-43e3-a7d9-e9e676c5f165 None None] Provisioning complete for port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:32:42.825676 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b8785bc3-ff71-43e3-a7d9-e9e676c5f165 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:42.826031 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6311cad9-2ecb-41f9-892d-e9972799b65f req-40c3e863-3344-4e63-99e1-e587c6bf6253 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:42.833847 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6311cad9-2ecb-41f9-892d-e9972799b65f req-40c3e863-3344-4e63-99e1-e587c6bf6253 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 932 time: 0.2108724 Dec 08 11:32:42.868581 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-b8785bc3-ff71-43e3-a7d9-e9e676c5f165 None None] Port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:32:42.915955 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-2216b228-5926-45da-aa6d-2ccab191ebaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:42.916489 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-2216b228-5926-45da-aa6d-2ccab191ebaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:42.987815 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-2216b228-5926-45da-aa6d-2ccab191ebaa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1073010 Dec 08 11:32:42.994199 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6311cad9-2ecb-41f9-892d-e9972799b65f req-8e0afff4-a528-4ae9-8deb-128f1b485f94 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1595116 Dec 08 11:32:42.999877 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] For port 1d5f08a0-9b25-48d8-a2ed-88647aec1670, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:32:43.003520 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] For port 1d5f08a0-9b25-48d8-a2ed-88647aec1670, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=1d5f08a0-9b25-48d8-a2ed-88647aec1670,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:32:43.020799 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c26b31e-774e-4915-a0b0-6971226cfba5 req-a3aaa8ea-23e7-4643-9eba-82282252531c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:43.022407 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0c26b31e-774e-4915-a0b0-6971226cfba5 req-a3aaa8ea-23e7-4643-9eba-82282252531c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 943 time: 0.1296411 Dec 08 11:32:43.024156 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:43.095902 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:32:43.096631 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:43.101055 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] 10.222.0.61 "PUT /v2.0/ports/1d5f08a0-9b25-48d8-a2ed-88647aec1670 HTTP/1.1" status: 200 len: 1093 time: 2.0883784 Dec 08 11:32:43.101894 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '96e47acb-aeed-4636-9a70-a1b987abaed6', 'tag': '1d5f08a0-9b25-48d8-a2ed-88647aec1670'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:32:43.104364 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d20a1c46-c3e0-4251-ab49-da4c82193f66" -d '{"events": [{"name": "network-changed", "server_uuid": "96e47acb-aeed-4636-9a70-a1b987abaed6", "tag": "1d5f08a0-9b25-48d8-a2ed-88647aec1670"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:32:43.135035 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c4d1355-aac8-47ba-86ab-154b740a6440 service neutron] Pushing event updated for resources: {'Port': ['ID=1d5f08a0-9b25-48d8-a2ed-88647aec1670,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:32:43.150847 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0c26b31e-774e-4915-a0b0-6971226cfba5 req-cddcb272-80d6-4502-bff3-db91f26ae380 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1211662 Dec 08 11:32:47.526653 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:52.453190 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-76cd7cc4-37a8-4b97-8e4b-1c76c6fba792 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:54.683845 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fd13e0bd-de9d-456f-83c1-1eb5057ca4fc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:55.761118 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:56.896101 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:32:57.117932 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:32:58.138358 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:09.406295 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Request body: {'port': {'device_id': 'ef74eb6c-4764-40c3-8610-e4f4bc3e610d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:09.409923 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Request body: {'port': {'device_id': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:09.462699 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:09.517681 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-3fccd937-c097-44cd-9b5b-6a94f605d0d3 service neutron] 10.222.0.61 "GET /v2.0/networks/1056c468-8569-46d3-ae01-3e9a87553272?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1141005 Dec 08 11:33:09.589752 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-edf825ff-e09d-403e-b3ec-3f830bc0ae9b req-c51d52b3-8941-4a2f-aa16-f3ccd056a1ab tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 210 time: 0.0471392 Dec 08 11:33:09.593661 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:32:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-823d2060-ed5d-4b51-9057-13d1877395d9 x-openstack-request-id: req-823d2060-ed5d-4b51-9057-13d1877395d9 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:33:09.593951 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "96e47acb-aeed-4636-9a70-a1b987abaed6", "tag": "1d5f08a0-9b25-48d8-a2ed-88647aec1670", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:33:09.594210 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-823d2060-ed5d-4b51-9057-13d1877395d9 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:33:09.594609 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '96e47acb-aeed-4636-9a70-a1b987abaed6', 'tag': '1d5f08a0-9b25-48d8-a2ed-88647aec1670', 'status': 'completed', 'code': 200} Dec 08 11:33:09.829229 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-301fabac-09b1-4abe-bf99-0072a39e919d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:09.830770 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-301fabac-09b1-4abe-bf99-0072a39e919d service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 1096 time: 0.2894421 Dec 08 11:33:09.845282 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33606e25-c2d8-446c-aaed-d209d743cfe4 req-f8d0d363-bae9-49a5-bfb7-ff99e8bba25c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:09.845534 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:09.846737 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33606e25-c2d8-446c-aaed-d209d743cfe4 req-f8d0d363-bae9-49a5-bfb7-ff99e8bba25c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 943 time: 0.2156596 Dec 08 11:33:09.873457 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-6cd14e8c-cace-454f-9feb-78c2b371fad2 req-71ceb848-e91a-49c4-8bf7-700b1a1fe3b7 service neutron] 10.222.0.61 "GET /v2.0/networks/1056c468-8569-46d3-ae01-3e9a87553272?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3346691 Dec 08 11:33:09.874194 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ec3ceb6-5ee4-4769-8224-357caa8a8b93 req-3ed768c6-8926-4077-95c0-ca1b9f9e2e5a tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:09.875624 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6ec3ceb6-5ee4-4769-8224-357caa8a8b93 req-3ed768c6-8926-4077-95c0-ca1b9f9e2e5a tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 932 time: 0.1795001 Dec 08 11:33:09.920669 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-dfd73e5b-b387-4189-aeae-2b058524f2b9 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=1d5f08a0-9b25-48d8-a2ed-88647aec1670 HTTP/1.1" status: 200 len: 217 time: 0.0694525 Dec 08 11:33:10.054005 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-a16d70a6-cd48-4fdb-a713-8ec975f6e632 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:10.055375 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-a16d70a6-cd48-4fdb-a713-8ec975f6e632 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=d6b1fb0e-d38f-47ca-a647-53b824c47e76 HTTP/1.1" status: 200 len: 853 time: 0.1114526 Dec 08 11:33:10.075586 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6ec3ceb6-5ee4-4769-8224-357caa8a8b93 req-1405901b-4a5e-494c-b824-602d78c78634 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1639636 Dec 08 11:33:10.083644 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33606e25-c2d8-446c-aaed-d209d743cfe4 req-49e68ece-89c4-46e6-9da2-bf41fe1cd893 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2122798 Dec 08 11:33:10.118711 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:33:10.122468 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-a7c26d9f-18fc-4e7a-b783-97ccc931cd97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:10.124268 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-a7c26d9f-18fc-4e7a-b783-97ccc931cd97 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=bde1d456ccb0411eaed7cb4c5c07de7d&device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 1096 time: 0.1046007 Dec 08 11:33:10.124432 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-30889ccd-77c1-4068-9f5f-d615552ecc67 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=6e4bda07-1ae1-4be4-bf28-e94211f51919&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0447137 Dec 08 11:33:10.129926 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:10.165578 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Transition to ACTIVE for port object 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:33:10.196198 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.61', 56911) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:10.199764 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:10.295584 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.notifiers.nova [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec {{(pid=102317) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:33:10.300587 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-7c77c1c1-86f1-4720-8235-06689236638d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:10.303537 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-7c77c1c1-86f1-4720-8235-06689236638d service neutron] 10.222.0.61 "GET /v2.0/networks?id=1056c468-8569-46d3-ae01-3e9a87553272 HTTP/1.1" status: 200 len: 910 time: 0.1590962 Dec 08 11:33:10.307461 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:10.322379 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.provisioning_blocks [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Transition to ACTIVE for port object 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec will not be triggered until provisioned by entity L2. {{(pid=102317) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:33:10.331131 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:10.376457 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-30be826f-c1c1-493f-9747-19041125774b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=6487232e-a2f6-40ee-bcd9-a49395653c34 HTTP/1.1" status: 200 len: 217 time: 0.0617766 Dec 08 11:33:10.497750 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-8c70122c-7aa0-4972-8bb1-686c8f70a1b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:10.499236 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-8c70122c-7aa0-4972-8bb1-686c8f70a1b8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=a2e78872-9414-489f-b73b-b06f4460aa93 HTTP/1.1" status: 200 len: 849 time: 0.0996552 Dec 08 11:33:10.499852 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Pushing event updated for resources: {'Port': ['ID=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:10.527464 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.527814 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.528158 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.528492 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.528823 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.529165 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.529502 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.529828 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.530170 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.530497 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.530818 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.531144 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.531465 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.558738 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.managers [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Attempting to bind port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:33:10.558738 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.managers [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Attempting to bind port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 289, 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187'}] {{(pid=102317) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:33:10.559138 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Attempting to bind port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec on network f5a54297-6b64-4f71-b9f2-2f9c14a03187 {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:10.562957 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-fb5d3e8e-e1c7-48a3-921a-1b5366bd218b service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=1056c468-8569-46d3-ae01-3e9a87553272&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0475178 Dec 08 11:33:10.568628 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec on network f5a54297-6b64-4f71-b9f2-2f9c14a03187 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:33:10.568628 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Attempting to bind port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec on network f5a54297-6b64-4f71-b9f2-2f9c14a03187 {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:10.573778 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 32, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:33:10.574149 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Checking segment: {'id': 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 289, 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:33:10.574537 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Bound using segment: {'id': 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 289, 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187'} {{(pid=102317) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:33:10.575012 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.managers [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Bound port: 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 289, 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187'}}] {{(pid=102317) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:33:10.575370 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:10.629733 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Pushing event updated for resources: {'Port': ['ID=96b6dc81-7654-48f5-ac3f-e3e4d35982b3,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:10.653217 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] For port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec, host hv-cinder-81977, cleared binding levels {{(pid=102317) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:33:10.656811 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] For port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102317) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:33:10.663119 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:10.676282 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f62e0b1b-35f2-45e0-bc7c-4bf776995196 req-a5ff4f98-dd2f-4aa6-921e-96b581276195 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:10.677792 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f62e0b1b-35f2-45e0-bc7c-4bf776995196 req-a5ff4f98-dd2f-4aa6-921e-96b581276195 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 943 time: 0.4804444 Dec 08 11:33:10.696700 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:10.697418 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for port, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:10.698791 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] 10.222.0.61 "PUT /v2.0/ports/7fe8b63d-f6cd-45dc-a53c-93b64cacfeec HTTP/1.1" status: 200 len: 1094 time: 1.2941782 Dec 08 11:33:10.699170 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec'}] {{(pid=102317) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:33:10.702017 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}212dae370a2b559de5b7d578af79073c1e0f4cb02126db35c6693ef88f95633e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-35197338-b9e0-4d6c-98f3-fb959088f8a4" -d '{"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]}' {{(pid=102317) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:33:10.708529 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.708851 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.709444 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.709628 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.709853 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.710182 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.710514 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.710836 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.711171 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.711476 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.711800 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.712132 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.712435 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:10.732415 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe838da9-e9ef-401b-b766-ee94d7e8fa75 service neutron] Pushing event updated for resources: {'Port': ['ID=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,revision_number=3']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:10.745630 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-322bd801-e2af-4b2a-b8b2-84731ef4190f service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6045890 Dec 08 11:33:10.774795 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-62601e4a-f800-4160-9712-737659ce7688 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:10.776296 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-62601e4a-f800-4160-9712-737659ce7688 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.61 "GET /v2.0/networks?id=b799b290-99c1-4693-82cc-42bbd4d90adb HTTP/1.1" status: 200 len: 819 time: 0.5773523 Dec 08 11:33:10.817387 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-383cf59a-e741-4083-bcef-79c9a6d8df78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Request body: {'port': {'device_id': 'f4f33a56-55e3-4bc1-a952-b90b6fde964c', 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb', 'admin_state_up': True, 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:10.911800 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-61fdabcf-f94b-4162-ae16-c5a1eea5bc9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:10.913361 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-61fdabcf-f94b-4162-ae16-c5a1eea5bc9a service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=3102b9c0f7ea45048750ae3c81085631&device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 1097 time: 0.0771961 Dec 08 11:33:10.919460 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-092db61d-12fa-458d-9d58-a806a2766085 service neutron] 10.222.0.61 "GET /v2.0/networks/1056c468-8569-46d3-ae01-3e9a87553272?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1407821 Dec 08 11:33:10.924174 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Attempting to bind port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:33:10.924174 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Attempting to bind port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': 'aa890c2f-8ce4-49b3-a366-4788a314e043', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 252, 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:33:10.924174 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Attempting to bind port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 on network b799b290-99c1-4693-82cc-42bbd4d90adb {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:10.933344 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f62e0b1b-35f2-45e0-bc7c-4bf776995196 req-0643fa23-a612-4446-b37e-523ab5901f3d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2273765 Dec 08 11:33:10.946609 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 on network b799b290-99c1-4693-82cc-42bbd4d90adb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:33:10.946934 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Attempting to bind port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 on network b799b290-99c1-4693-82cc-42bbd4d90adb {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:10.974471 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 32, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:33:10.974817 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Checking segment: {'id': 'aa890c2f-8ce4-49b3-a366-4788a314e043', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 252, 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:33:10.975361 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Bound using segment: {'id': 'aa890c2f-8ce4-49b3-a366-4788a314e043', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 252, 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:33:10.975653 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Bound port: 96b6dc81-7654-48f5-ac3f-e3e4d35982b3, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'aa890c2f-8ce4-49b3-a366-4788a314e043', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 252, 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:33:10.976011 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:11.021303 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:33:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e57dcf4d-8db1-4d7f-b45f-7d478181e13f x-openstack-request-id: req-e57dcf4d-8db1-4d7f-b45f-7d478181e13f {{(pid=102317) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:33:11.021717 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec", "status": "completed", "code": 200}]} {{(pid=102317) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:33:11.022082 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-e57dcf4d-8db1-4d7f-b45f-7d478181e13f {{(pid=102317) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:33:11.022271 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f683c32a-587c-4e27-b696-0d3784ffbc1d req-6f1d51d9-9f03-4c0c-98d6-290b7e9c71df service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2407753 Dec 08 11:33:11.022644 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec', 'status': 'completed', 'code': 200} Dec 08 11:33:11.033466 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-4206c98d-818e-488d-b32e-3b932ecab276 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec HTTP/1.1" status: 200 len: 217 time: 0.1022162 Dec 08 11:33:11.092921 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8158f05b-c64b-45de-9aae-8238dd9f86e3 req-94a68b91-e897-47fd-a93d-2b4c07aab104 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 210 time: 0.0439866 Dec 08 11:33:11.123865 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-aeb8c572-5f00-4e3b-8150-30aa20b9c679 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.125528 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-aeb8c572-5f00-4e3b-8150-30aa20b9c679 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=07f39602-a4ed-4df9-a6e2-9c0943b66135 HTTP/1.1" status: 200 len: 853 time: 0.0657997 Dec 08 11:33:11.155182 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-383cf59a-e741-4083-bcef-79c9a6d8df78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Made reservation on behalf of 801ccccb4d7647de8e9558e07ebdc070 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:33:11.158989 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-383cf59a-e741-4083-bcef-79c9a6d8df78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:11.167947 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] For port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:33:11.194870 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] For port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=96b6dc81-7654-48f5-ac3f-e3e4d35982b3,segment=NetworkSegment(aa890c2f-8ce4-49b3-a366-4788a314e043),segment_id=aa890c2f-8ce4-49b3-a366-4788a314e043)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:33:11.198507 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-050ba309-e6d9-431c-93ce-b75323a7faee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.200135 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-050ba309-e6d9-431c-93ce-b75323a7faee service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 1096 time: 0.1134145 Dec 08 11:33:11.205846 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:11.210525 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-6f4979c6-3fed-47aa-b6fb-d2680e97912e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.212298 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-6f4979c6-3fed-47aa-b6fb-d2680e97912e service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=f5a54297-6b64-4f71-b9f2-2f9c14a03187&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0770290 Dec 08 11:33:11.214761 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-c9b520e8-53fa-4106-a0a4-10f14a877310 service neutron] 10.222.0.61 "GET /v2.0/networks/1056c468-8569-46d3-ae01-3e9a87553272?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2748022 Dec 08 11:33:11.307607 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-f5e8bf8d-284f-47b0-80af-a6f267e16760 service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835130 Dec 08 11:33:11.322464 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.323083 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:11.324644 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] 10.222.0.61 "PUT /v2.0/ports/96b6dc81-7654-48f5-ac3f-e3e4d35982b3 HTTP/1.1" status: 200 len: 1093 time: 1.9230607 Dec 08 11:33:11.403805 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-381bc50d-c9ba-4c40-aa42-94e243128516 req-d9320809-289d-462e-82aa-0585dcd67d00 service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893080 Dec 08 11:33:11.484950 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-186165d3-d29a-4e6f-8da4-e000b0ea7826 service neutron] Pushing event updated for resources: {'Port': ['ID=96b6dc81-7654-48f5-ac3f-e3e4d35982b3,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:11.509959 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51a1f078-84e4-4fd6-a463-1f086b87dbcf req-30f91421-91b2-4ccf-b14d-ef81dbff1843 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.512073 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-51a1f078-84e4-4fd6-a463-1f086b87dbcf req-30f91421-91b2-4ccf-b14d-ef81dbff1843 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 944 time: 0.2906992 Dec 08 11:33:11.521186 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-3d3610f9-f6ef-40ee-967c-764a486ab07f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.522718 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-3d3610f9-f6ef-40ee-967c-764a486ab07f service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=3102b9c0f7ea45048750ae3c81085631&device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 1097 time: 0.0449054 Dec 08 11:33:11.553121 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a07af4-4f16-4c59-aac1-b326ad0c97cc req-bfd0036f-81be-4865-be4f-12a96b4ebd52 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.554774 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-40a07af4-4f16-4c59-aac1-b326ad0c97cc req-bfd0036f-81be-4865-be4f-12a96b4ebd52 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 943 time: 0.3114870 Dec 08 11:33:11.574522 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-42659203-c5f3-4c12-87b9-f67a95608984 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.575872 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-42659203-c5f3-4c12-87b9-f67a95608984 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=801ccccb4d7647de8e9558e07ebdc070&device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 1096 time: 0.1899331 Dec 08 11:33:11.589131 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-32b63959-78f5-4aa4-af7a-6c3db7caf51f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.590660 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-32b63959-78f5-4aa4-af7a-6c3db7caf51f service neutron] 10.222.0.61 "GET /v2.0/networks?id=6e4bda07-1ae1-4be4-bf28-e94211f51919 HTTP/1.1" status: 200 len: 914 time: 0.3807285 Dec 08 11:33:11.598054 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ef74eb6c-4764-40c3-8610-e4f4bc3e610d', 'tag': '96b6dc81-7654-48f5-ac3f-e3e4d35982b3'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:33:11.600262 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07160530-5950-45ee-8de7-f7b598d050a3" -d '{"events": [{"name": "network-changed", "server_uuid": "ef74eb6c-4764-40c3-8610-e4f4bc3e610d", "tag": "96b6dc81-7654-48f5-ac3f-e3e4d35982b3"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:33:11.623336 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-dfdec7ca-a16b-49ea-bea4-327aa34ad2b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.624829 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-dfdec7ca-a16b-49ea-bea4-327aa34ad2b9 service neutron] 10.222.0.61 "GET /v2.0/networks?id=f5a54297-6b64-4f71-b9f2-2f9c14a03187 HTTP/1.1" status: 200 len: 915 time: 0.0942690 Dec 08 11:33:11.668972 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-8c2ef284-2c13-4a88-b9d9-54012550314c service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec HTTP/1.1" status: 200 len: 217 time: 0.0353308 Dec 08 11:33:11.705335 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-89eb3b54-c3ff-464f-bfdb-470f3159734c service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=1d5f08a0-9b25-48d8-a2ed-88647aec1670 HTTP/1.1" status: 200 len: 217 time: 0.0934589 Dec 08 11:33:11.706539 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-4fbee6e3-6ed1-47f4-89d3-38f196caa6f8 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=96b6dc81-7654-48f5-ac3f-e3e4d35982b3 HTTP/1.1" status: 200 len: 217 time: 0.1102939 Dec 08 11:33:11.709975 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-383cf59a-e741-4083-bcef-79c9a6d8df78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Allocated IP 172.20.0.13 (b799b290-99c1-4693-82cc-42bbd4d90adb/59ab11c2-3db5-4069-afa6-b6f825d69316/ec0c1efb-b1b3-47b8-91c5-b30707a7222f) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:33:11.719749 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-88fbd208-e706-4429-9bca-3155df4ae51e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.721321 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-88fbd208-e706-4429-9bca-3155df4ae51e service neutron] 10.222.0.61 "GET /v2.0/subnets?id=07f39602-a4ed-4df9-a6e2-9c0943b66135 HTTP/1.1" status: 200 len: 853 time: 0.0450292 Dec 08 11:33:11.772095 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-2b905a4c-2a4f-458e-a07d-257a0ca18bea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.773638 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-2b905a4c-2a4f-458e-a07d-257a0ca18bea service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=f5a54297-6b64-4f71-b9f2-2f9c14a03187&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0452011 Dec 08 11:33:11.815263 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-51a1f078-84e4-4fd6-a463-1f086b87dbcf req-2cb4785d-3a6e-44b5-95a2-d3608d3946e3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2682681 Dec 08 11:33:11.820387 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-40a07af4-4f16-4c59-aac1-b326ad0c97cc req-bdaad985-93cc-4a3c-8e80-6cb802977bb2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2542689 Dec 08 11:33:11.874327 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:33:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-91c0ca8f-7d46-4da2-a1a0-e07f502c6b4d x-openstack-request-id: req-91c0ca8f-7d46-4da2-a1a0-e07f502c6b4d {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:33:11.874622 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ef74eb6c-4764-40c3-8610-e4f4bc3e610d", "tag": "96b6dc81-7654-48f5-ac3f-e3e4d35982b3", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:33:11.874876 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-91c0ca8f-7d46-4da2-a1a0-e07f502c6b4d {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:33:11.875261 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ef74eb6c-4764-40c3-8610-e4f4bc3e610d', 'tag': '96b6dc81-7654-48f5-ac3f-e3e4d35982b3', 'status': 'completed', 'code': 200} Dec 08 11:33:11.881255 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-9ed40e54-cc9b-437d-8624-737c0f381bd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.882837 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-9ed40e54-cc9b-437d-8624-737c0f381bd9 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=d6b1fb0e-d38f-47ca-a647-53b824c47e76 HTTP/1.1" status: 200 len: 853 time: 0.1571867 Dec 08 11:33:11.892611 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-9881beb7-4dd8-4407-ae66-592c6694ac25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:11.894305 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-9881beb7-4dd8-4407-ae66-592c6694ac25 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59ab11c2-3db5-4069-afa6-b6f825d69316 HTTP/1.1" status: 200 len: 859 time: 0.1708329 Dec 08 11:33:11.896264 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-97659554-9784-4793-bec4-b1b351f0e522 service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1150265 Dec 08 11:33:11.986308 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-2d9031b2-6caf-4127-b7bd-ca2f28020649 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=6e4bda07-1ae1-4be4-bf28-e94211f51919&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0476942 Dec 08 11:33:11.989876 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-3af7fc9f-53cb-46f8-a777-103f3745febc service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b799b290-99c1-4693-82cc-42bbd4d90adb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0524426 Dec 08 11:33:12.007276 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-35197338-b9e0-4d6c-98f3-fb959088f8a4 req-aff6b057-65b3-4044-b66e-e01778415d39 service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0920739 Dec 08 11:33:12.146967 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-383cf59a-e741-4083-bcef-79c9a6d8df78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:12.206884 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-7ef666cb-3b6e-46b0-9c95-63052152e558 service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2055759 Dec 08 11:33:12.210007 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-60cc399c-b61f-44a6-a96b-825c9b6f560d service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2077422 Dec 08 11:33:12.220889 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-383cf59a-e741-4083-bcef-79c9a6d8df78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:12.367960 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-383cf59a-e741-4083-bcef-79c9a6d8df78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Network b799b290-99c1-4693-82cc-42bbd4d90adb is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:33:12.377271 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-383cf59a-e741-4083-bcef-79c9a6d8df78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:12.379570 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-383cf59a-e741-4083-bcef-79c9a6d8df78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Pushing event updated for resources: {'Port': ['ID=ec0c1efb-b1b3-47b8-91c5-b30707a7222f,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:12.383129 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-383cf59a-e741-4083-bcef-79c9a6d8df78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:33:12.458880 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d20a1c46-c3e0-4251-ab49-da4c82193f66 req-02c72688-31ad-4ff9-8168-5c980896f407 service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2360559 Dec 08 11:33:12.467344 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bad59d13-96fa-4d64-b0de-b71c215076c6 req-675acae0-bc51-45ef-8a8a-60971f7c38f9 service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2434151 Dec 08 11:33:12.475408 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-383cf59a-e741-4083-bcef-79c9a6d8df78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:12.476022 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-383cf59a-e741-4083-bcef-79c9a6d8df78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:12.492466 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-383cf59a-e741-4083-bcef-79c9a6d8df78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.6938398 Dec 08 11:33:12.521506 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Request body: {'port': {'device_id': 'f4f33a56-55e3-4bc1-a952-b90b6fde964c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:12.619071 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:12.624628 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07160530-5950-45ee-8de7-f7b598d050a3 req-82c66ab0-1447-44c2-8ce1-d947e5f0de9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:12.626271 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-07160530-5950-45ee-8de7-f7b598d050a3 req-82c66ab0-1447-44c2-8ce1-d947e5f0de9a service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=801ccccb4d7647de8e9558e07ebdc070&device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 1096 time: 0.1019607 Dec 08 11:33:13.013354 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c373dce0-1ccb-4c47-816f-64f500e122b1 req-d4836035-7d53-4adc-8390-40866073bc65 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:13.014735 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c373dce0-1ccb-4c47-816f-64f500e122b1 req-d4836035-7d53-4adc-8390-40866073bc65 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 943 time: 0.4114103 Dec 08 11:33:13.039942 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84326d18-054a-4fb5-8297-f19144166140 req-0ea438c5-0808-461e-a697-bf0ffaa3eb1b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:13.041364 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-84326d18-054a-4fb5-8297-f19144166140 req-0ea438c5-0808-461e-a697-bf0ffaa3eb1b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 932 time: 0.4243131 Dec 08 11:33:13.138053 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07160530-5950-45ee-8de7-f7b598d050a3 req-4530bad1-cf0f-4849-8366-85111bc5d9e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:13.139539 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-07160530-5950-45ee-8de7-f7b598d050a3 req-4530bad1-cf0f-4849-8366-85111bc5d9e0 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b799b290-99c1-4693-82cc-42bbd4d90adb HTTP/1.1" status: 200 len: 920 time: 0.4846175 Dec 08 11:33:13.218719 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-07160530-5950-45ee-8de7-f7b598d050a3 req-0608b171-c5c2-4c48-b787-67df30a22596 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=96b6dc81-7654-48f5-ac3f-e3e4d35982b3 HTTP/1.1" status: 200 len: 217 time: 0.0671706 Dec 08 11:33:13.241728 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c373dce0-1ccb-4c47-816f-64f500e122b1 req-000d8a89-e1f0-4a3e-9e93-8c905dccf287 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2127764 Dec 08 11:33:13.279623 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-84326d18-054a-4fb5-8297-f19144166140 req-9364b44a-66b0-4e98-9a10-ae305674acb8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2250674 Dec 08 11:33:13.368423 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07160530-5950-45ee-8de7-f7b598d050a3 req-bb9226fa-e739-433e-bfac-2726c4502d6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:13.369881 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-07160530-5950-45ee-8de7-f7b598d050a3 req-bb9226fa-e739-433e-bfac-2726c4502d6b service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59ab11c2-3db5-4069-afa6-b6f825d69316 HTTP/1.1" status: 200 len: 859 time: 0.1325707 Dec 08 11:33:13.436139 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-07160530-5950-45ee-8de7-f7b598d050a3 req-75fdc580-4771-4380-acc8-22f805c8c87b service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b799b290-99c1-4693-82cc-42bbd4d90adb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0488617 Dec 08 11:33:13.458228 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-964e3be5-78ad-4691-9dbc-6103862f769e req-cbd1b93c-4902-4e4a-b802-d49d3dc12689 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:13.459732 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-964e3be5-78ad-4691-9dbc-6103862f769e req-cbd1b93c-4902-4e4a-b802-d49d3dc12689 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 944 time: 0.1501124 Dec 08 11:33:13.533771 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951c8265-bbe2-43b3-be10-9b3d81ef273e req-7182b260-9609-4a5e-80e8-42c4aad0cfe1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:13.535789 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-951c8265-bbe2-43b3-be10-9b3d81ef273e req-7182b260-9609-4a5e-80e8-42c4aad0cfe1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 943 time: 0.1917543 Dec 08 11:33:13.637956 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-964e3be5-78ad-4691-9dbc-6103862f769e req-993003fe-3efd-4b52-a2fb-2e5d20160030 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1693423 Dec 08 11:33:13.650644 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ec0c1efb-b1b3-47b8-91c5-b30707a7222f {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:33:13.663399 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:13.687491 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-07160530-5950-45ee-8de7-f7b598d050a3 req-cad43979-b52a-4952-8319-1377f31116f4 service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2387934 Dec 08 11:33:13.693319 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-951c8265-bbe2-43b3-be10-9b3d81ef273e req-e2be67c0-ecbf-40dd-9b4a-24f9e06f9205 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1496327 Dec 08 11:33:13.696024 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Transition to ACTIVE for port object ec0c1efb-b1b3-47b8-91c5-b30707a7222f will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:33:13.716593 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:13.812380 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Pushing event updated for resources: {'Port': ['ID=ec0c1efb-b1b3-47b8-91c5-b30707a7222f,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:13.873202 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-07160530-5950-45ee-8de7-f7b598d050a3 req-8a24d260-1e0c-4e54-a738-63e1fd21b0e0 service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1750212 Dec 08 11:33:13.898226 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Attempting to bind port ec0c1efb-b1b3-47b8-91c5-b30707a7222f on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:33:13.898555 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Attempting to bind port ec0c1efb-b1b3-47b8-91c5-b30707a7222f by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': 'aa890c2f-8ce4-49b3-a366-4788a314e043', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 252, 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:33:13.898908 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Attempting to bind port ec0c1efb-b1b3-47b8-91c5-b30707a7222f on network b799b290-99c1-4693-82cc-42bbd4d90adb {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:13.903148 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Port ec0c1efb-b1b3-47b8-91c5-b30707a7222f on network b799b290-99c1-4693-82cc-42bbd4d90adb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:33:13.903462 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Attempting to bind port ec0c1efb-b1b3-47b8-91c5-b30707a7222f on network b799b290-99c1-4693-82cc-42bbd4d90adb {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:13.908165 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 32, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:33:13.908494 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Checking segment: {'id': 'aa890c2f-8ce4-49b3-a366-4788a314e043', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 252, 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:33:13.908864 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Bound using segment: {'id': 'aa890c2f-8ce4-49b3-a366-4788a314e043', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 252, 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:33:13.909319 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Bound port: ec0c1efb-b1b3-47b8-91c5-b30707a7222f, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'aa890c2f-8ce4-49b3-a366-4788a314e043', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 252, 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:33:13.909667 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:13.973280 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] For port ec0c1efb-b1b3-47b8-91c5-b30707a7222f, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:33:13.976181 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] For port ec0c1efb-b1b3-47b8-91c5-b30707a7222f, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=ec0c1efb-b1b3-47b8-91c5-b30707a7222f,segment=NetworkSegment(aa890c2f-8ce4-49b3-a366-4788a314e043),segment_id=aa890c2f-8ce4-49b3-a366-4788a314e043)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:33:13.979665 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:14.010757 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:14.011361 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:14.012722 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-7caead7b-db8f-46e2-a054-53167148066d service neutron] 10.222.0.61 "PUT /v2.0/ports/ec0c1efb-b1b3-47b8-91c5-b30707a7222f HTTP/1.1" status: 200 len: 1094 time: 1.4962094 Dec 08 11:33:14.013168 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f4f33a56-55e3-4bc1-a952-b90b6fde964c', 'tag': 'ec0c1efb-b1b3-47b8-91c5-b30707a7222f'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:33:14.015387 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-804b18d8-aa1c-468a-b252-e4b6567fe78c" -d '{"events": [{"name": "network-changed", "server_uuid": "f4f33a56-55e3-4bc1-a952-b90b6fde964c", "tag": "ec0c1efb-b1b3-47b8-91c5-b30707a7222f"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:33:14.041868 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7caead7b-db8f-46e2-a054-53167148066d service neutron] Pushing event updated for resources: {'Port': ['ID=ec0c1efb-b1b3-47b8-91c5-b30707a7222f,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:14.053824 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:33:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7080c736-32c2-40ac-8f7d-415da68974f5 x-openstack-request-id: req-7080c736-32c2-40ac-8f7d-415da68974f5 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:33:14.054108 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f4f33a56-55e3-4bc1-a952-b90b6fde964c", "tag": "ec0c1efb-b1b3-47b8-91c5-b30707a7222f", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:33:14.054362 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-7080c736-32c2-40ac-8f7d-415da68974f5 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:33:14.054749 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f4f33a56-55e3-4bc1-a952-b90b6fde964c', 'tag': 'ec0c1efb-b1b3-47b8-91c5-b30707a7222f', 'status': 'completed', 'code': 200} Dec 08 11:33:14.101026 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-24756810-56ee-4a42-adc9-28310c92b4dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:14.102554 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-24756810-56ee-4a42-adc9-28310c92b4dd service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=801ccccb4d7647de8e9558e07ebdc070&device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 1097 time: 0.0412972 Dec 08 11:33:14.150065 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-41be4d67-5ff1-4919-9bc5-611f3d099a5d service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ec0c1efb-b1b3-47b8-91c5-b30707a7222f HTTP/1.1" status: 200 len: 217 time: 0.0390685 Dec 08 11:33:14.197928 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-1c11154d-08ca-4254-9054-a132e1a78ff2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:14.199344 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-1c11154d-08ca-4254-9054-a132e1a78ff2 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59ab11c2-3db5-4069-afa6-b6f825d69316 HTTP/1.1" status: 200 len: 859 time: 0.0424235 Dec 08 11:33:14.230992 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-13dfab39-8a04-43a9-8260-b7b2676dc77e service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b799b290-99c1-4693-82cc-42bbd4d90adb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0229306 Dec 08 11:33:14.334188 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-ac6e096f-148f-40c7-99d9-6f8251c700c6 service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0948703 Dec 08 11:33:14.449377 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ab64735-15aa-43e1-9d8b-d9b8bbfa4b92 req-66a87ef1-86d5-406b-b4f8-7e9c3aa05a59 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:14.450852 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6ab64735-15aa-43e1-9d8b-d9b8bbfa4b92 req-66a87ef1-86d5-406b-b4f8-7e9c3aa05a59 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 943 time: 0.1399772 Dec 08 11:33:14.480650 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfa19eee-9c1c-4519-affd-e64c380f599c req-0d8a375a-f782-4120-bab8-1c3b9cd16372 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:14.482509 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cfa19eee-9c1c-4519-affd-e64c380f599c req-0d8a375a-f782-4120-bab8-1c3b9cd16372 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 944 time: 0.1249483 Dec 08 11:33:14.525930 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c79cd686-2ca7-4364-9902-aeeaf2c1e1ea req-262ca3e3-0cb4-4e59-8b02-7efc31a499ed service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1787312 Dec 08 11:33:14.570779 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6ab64735-15aa-43e1-9d8b-d9b8bbfa4b92 req-4bc91064-32a4-4b1d-8242-ba29f9abc247 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1072941 Dec 08 11:33:14.580346 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cfa19eee-9c1c-4519-affd-e64c380f599c req-fe555227-3381-49bb-a72c-bd8b06fad517 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0840662 Dec 08 11:33:14.622384 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-ac77b2d7-b5ff-47a9-ac72-7d8a8d4b4087 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:14.623882 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-ac77b2d7-b5ff-47a9-ac72-7d8a8d4b4087 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=801ccccb4d7647de8e9558e07ebdc070&device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 1097 time: 0.0426366 Dec 08 11:33:14.700455 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52100) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:14.758132 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-1c23c08d-38af-4b98-ad75-dd574145dd61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:14.760725 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-1c23c08d-38af-4b98-ad75-dd574145dd61 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b799b290-99c1-4693-82cc-42bbd4d90adb HTTP/1.1" status: 200 len: 920 time: 0.1219149 Dec 08 11:33:14.833317 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dcd89ea7-10fd-4cd2-95c2-82b7c37ed654 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:14.850525 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-9e6c6707-bc0c-4b37-bd65-9093d4d1401b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ec0c1efb-b1b3-47b8-91c5-b30707a7222f HTTP/1.1" status: 200 len: 217 time: 0.0500426 Dec 08 11:33:14.860840 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5504a059-a03f-4687-8edb-25ae3bc8590b req-1021c86f-582d-458d-a2d7-d45b97dd49b9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:14.862325 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5504a059-a03f-4687-8edb-25ae3bc8590b req-1021c86f-582d-458d-a2d7-d45b97dd49b9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 944 time: 0.1494339 Dec 08 11:33:14.906075 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e754543b-bb5c-4d74-9a14-7c8b62c5f637 req-e92a07eb-1386-4aeb-aba0-f79d23b87a5e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:14.907567 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e754543b-bb5c-4d74-9a14-7c8b62c5f637 req-e92a07eb-1386-4aeb-aba0-f79d23b87a5e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 943 time: 0.1420171 Dec 08 11:33:14.909262 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dcd89ea7-10fd-4cd2-95c2-82b7c37ed654 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:14.913241 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dcd89ea7-10fd-4cd2-95c2-82b7c37ed654 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:14.950930 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-9231f308-0059-47f3-9a8c-b9be5b05b9c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:14.952022 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-dcd89ea7-10fd-4cd2-95c2-82b7c37ed654 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=1adafdc8620643bbba710c3d5a4529f3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2503874 Dec 08 11:33:14.952387 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-9231f308-0059-47f3-9a8c-b9be5b05b9c8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59ab11c2-3db5-4069-afa6-b6f825d69316 HTTP/1.1" status: 200 len: 859 time: 0.0891857 Dec 08 11:33:14.952889 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcd89ea7-10fd-4cd2-95c2-82b7c37ed654 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5a1b5ac-0730-4672-8878-c0a756fadccb,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:14.955154 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52112) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:15.003299 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e53b4a50-c63b-41d4-8db5-af8871aa3f8b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:15.007373 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-79ccff05-0ed3-4f03-9fb9-5ff048eba379 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b799b290-99c1-4693-82cc-42bbd4d90adb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0464890 Dec 08 11:33:15.013668 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5504a059-a03f-4687-8edb-25ae3bc8590b req-4bc4aef2-237c-43bb-a71b-8646a02bf612 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1414366 Dec 08 11:33:15.031041 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e53b4a50-c63b-41d4-8db5-af8871aa3f8b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:15.043422 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e754543b-bb5c-4d74-9a14-7c8b62c5f637 req-5e57db5a-4db6-4105-8f4f-61f628cd13c1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1241765 Dec 08 11:33:15.098991 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e53b4a50-c63b-41d4-8db5-af8871aa3f8b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:15.101837 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e53b4a50-c63b-41d4-8db5-af8871aa3f8b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:15.102982 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-e53b4a50-c63b-41d4-8db5-af8871aa3f8b admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/b5a1b5ac-0730-4672-8878-c0a756fadccb HTTP/1.1" status: 204 len: 168 time: 0.1467597 Dec 08 11:33:15.134100 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e53b4a50-c63b-41d4-8db5-af8871aa3f8b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5a1b5ac-0730-4672-8878-c0a756fadccb,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:15.149956 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-86bd50d9-f1b5-430d-863f-2af66ce7c1bf service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1314039 Dec 08 11:33:15.208845 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bdc80824-0e62-4e7f-8a64-eb68bcabf863 req-709b8bce-341f-4d65-b61c-b5d9dbb685cc service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0976167 Dec 08 11:33:15.280174 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-804b18d8-aa1c-468a-b252-e4b6567fe78c req-0640df14-def9-4a2c-90b5-23868b1c4ca6 service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1219532 Dec 08 11:33:15.289474 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc80824-0e62-4e7f-8a64-eb68bcabf863 req-a213c4fc-6745-4d5f-bdb5-ffc84dcf38b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:15.290891 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bdc80824-0e62-4e7f-8a64-eb68bcabf863 req-a213c4fc-6745-4d5f-bdb5-ffc84dcf38b5 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=9c60094b48d34489b46e92ae73d7e33a&device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 1098 time: 0.0536819 Dec 08 11:33:15.417489 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc80824-0e62-4e7f-8a64-eb68bcabf863 req-34c89e8f-9fc5-4633-ba4b-eea0ab435d34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:15.417679 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bdc80824-0e62-4e7f-8a64-eb68bcabf863 req-34c89e8f-9fc5-4633-ba4b-eea0ab435d34 service neutron] 10.222.0.61 "GET /v2.0/networks?id=185aeb08-41ef-4fae-a420-33296f710850 HTTP/1.1" status: 200 len: 911 time: 0.0942197 Dec 08 11:33:15.485979 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bdc80824-0e62-4e7f-8a64-eb68bcabf863 req-1373e4ad-b67c-4bfa-8238-6f7d355c410f service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=731fa8a4-e27d-4561-a86e-aa21c87548e7 HTTP/1.1" status: 200 len: 1001 time: 0.0599873 Dec 08 11:33:15.539895 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc80824-0e62-4e7f-8a64-eb68bcabf863 req-1852a00c-5f75-4a41-bd55-cff422904701 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:15.541395 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bdc80824-0e62-4e7f-8a64-eb68bcabf863 req-1852a00c-5f75-4a41-bd55-cff422904701 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=40a584f7-ce77-4d89-87c2-4f3f589c6700 HTTP/1.1" status: 200 len: 849 time: 0.0454757 Dec 08 11:33:15.595801 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc80824-0e62-4e7f-8a64-eb68bcabf863 req-f129cd65-fd5d-4403-a625-cd9cf14f7246 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:15.597338 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bdc80824-0e62-4e7f-8a64-eb68bcabf863 req-f129cd65-fd5d-4403-a625-cd9cf14f7246 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=185aeb08-41ef-4fae-a420-33296f710850&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0442317 Dec 08 11:33:15.754912 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bdc80824-0e62-4e7f-8a64-eb68bcabf863 req-b3ee150d-cf7b-4678-b26c-6baf67d1b919 service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1489193 Dec 08 11:33:15.770297 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52138) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:15.783516 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c10ed8-5d30-467e-b673-53f189dba75a req-627ae2b4-b785-4c0f-a243-98739b26471a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:15.784953 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-94c10ed8-5d30-467e-b673-53f189dba75a req-627ae2b4-b785-4c0f-a243-98739b26471a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 944 time: 0.1026242 Dec 08 11:33:15.791985 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee34ce6-2a0d-4794-bddd-36c495d3248c req-64fc964e-0f6a-43aa-9829-468545bd8797 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:15.793365 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3ee34ce6-2a0d-4794-bddd-36c495d3248c req-64fc964e-0f6a-43aa-9829-468545bd8797 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 943 time: 0.1133423 Dec 08 11:33:15.876289 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-2116727497-network', 'tenant_id': 'b1b41ae149164acbb31b021c9049b500'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:15.899339 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Made reservation on behalf of b1b41ae149164acbb31b021c9049b500 for: {'network': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:33:15.901739 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:15.913315 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:16.012201 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:16.018322 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:16.044707 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] vlan segment allocate from pool success with {'vlan_id': 269, 'physical_network': 'physnet1'} {{(pid=102317) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:33:16.055650 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17fd259e-0c88-4f2b-9716-9b0c3abb9504,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:16.060837 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:16.061212 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.segments_db [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Added segment 93ea5ca7-22ef-4002-8579-aa09922044a7 of type vlan for network a19166f1-a36a-4f08-8a61-f4d3fa1e8383 Dec 08 11:33:16.106374 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:16.142456 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:16.143189 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:16.144111 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:16.178647 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.4071734 Dec 08 11:33:16.190504 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 52152) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:16.199491 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-94c10ed8-5d30-467e-b673-53f189dba75a req-16526bc3-b462-4210-962a-7e394d6eff98 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4051683 Dec 08 11:33:16.207884 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-d45d046b-ac0c-4251-81f8-429e255ca4ff admin admin] Request body: {'subnet': {'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-2116727497-subnet', 'tenant_id': 'b1b41ae149164acbb31b021c9049b500', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:16.218812 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3ee34ce6-2a0d-4794-bddd-36c495d3248c req-5a5b92b8-3116-4ec8-892a-322dc10f6f46 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4081707 Dec 08 11:33:16.235053 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bdc80824-0e62-4e7f-8a64-eb68bcabf863 req-ea81c729-3012-49ae-9ea4-27817bc93ce8 service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4699469 Dec 08 11:33:16.245964 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d26461a-8343-4783-b99c-1ed6df6e650e admin admin] Pushing event updated for resources: {'Network': ['ID=a19166f1-a36a-4f08-8a61-f4d3fa1e8383,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:16.247933 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d45d046b-ac0c-4251-81f8-429e255ca4ff admin admin] Made reservation on behalf of b1b41ae149164acbb31b021c9049b500 for: {'subnet': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:33:16.259133 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d45d046b-ac0c-4251-81f8-429e255ca4ff admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-16496611'] for subnet, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:16.261035 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network a19166f1-a36a-4f08-8a61-f4d3fa1e8383 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:33:16.462234 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488e15c7-3a4c-4085-b095-fe7644f15111 req-a2da2ae1-b4b8-4849-855d-6c4d26317cc5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:16.463706 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-488e15c7-3a4c-4085-b095-fe7644f15111 req-a2da2ae1-b4b8-4849-855d-6c4d26317cc5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 943 time: 0.1229453 Dec 08 11:33:16.475144 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78848891-76a2-44c4-9e3f-0c23839a262d req-a58da6e5-02c2-4eb7-88c0-df696f803b86 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:16.476483 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-78848891-76a2-44c4-9e3f-0c23839a262d req-a58da6e5-02c2-4eb7-88c0-df696f803b86 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 944 time: 0.1190627 Dec 08 11:33:16.595771 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-488e15c7-3a4c-4085-b095-fe7644f15111 req-9ab49de6-8d14-40fd-8670-d2c6a6a3ee31 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1167309 Dec 08 11:33:16.597189 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d45d046b-ac0c-4251-81f8-429e255ca4ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4572227', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-16496629'] for subnet, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:16.605172 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-78848891-76a2-44c4-9e3f-0c23839a262d req-6208427c-19b1-4360-aa12-5c6ac0993d42 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1162758 Dec 08 11:33:16.661081 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d45d046b-ac0c-4251-81f8-429e255ca4ff admin admin] Pushing event updated for resources: {'Subnet': ['ID=095735e3-fae9-450c-a1b3-5a4932e6f812,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:16.674044 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d45d046b-ac0c-4251-81f8-429e255ca4ff admin admin] Checking segment: {'id': '93ea5ca7-22ef-4002-8579-aa09922044a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 269, 'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:33:16.674484 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d45d046b-ac0c-4251-81f8-429e255ca4ff admin admin] Network hostable DHCP agents. Network: a19166f1-a36a-4f08-8a61-f4d3fa1e8383, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102318) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:33:16.690792 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d45d046b-ac0c-4251-81f8-429e255ca4ff admin admin] Network a19166f1-a36a-4f08-8a61-f4d3fa1e8383 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102318) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:33:16.699190 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-d45d046b-ac0c-4251-81f8-429e255ca4ff admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, a19166f1-a36a-4f08-8a61-f4d3fa1e8383) {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:16.703451 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d45d046b-ac0c-4251-81f8-429e255ca4ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:16.704123 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d45d046b-ac0c-4251-81f8-429e255ca4ff admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:16.709273 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db5b8d4e-feeb-4230-a247-cf525ce346bd None None] Network a19166f1-a36a-4f08-8a61-f4d3fa1e8383 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:33:16.720573 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-d45d046b-ac0c-4251-81f8-429e255ca4ff admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.5290275 Dec 08 11:33:16.802868 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-08aafbe0-75ab-4875-9d6a-7b842250a7e1 None None] Network a19166f1-a36a-4f08-8a61-f4d3fa1e8383 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:33:17.328833 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 6487232e-a2f6-40ee-bcd9-a49395653c34 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:33:17.438306 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 6487232e-a2f6-40ee-bcd9-a49395653c34, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=6487232e-a2f6-40ee-bcd9-a49395653c34,segment=NetworkSegment(c37df7a5-94f5-4cf8-8161-23e912b124b9),segment_id=c37df7a5-94f5-4cf8-8161-23e912b124b9)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:17.450349 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '6487232e-a2f6-40ee-bcd9-a49395653c34', 'network_id': '1056c468-8569-46d3-ae01-3e9a87553272', 'port_id': '6487232e-a2f6-40ee-bcd9-a49395653c34', 'mac_address': 'fa:16:3e:7a:c3:a3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 291, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a2e78872-9414-489f-b73b-b06f4460aa93', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:33:17.458277 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-310dc2d2-76f9-4b00-b0c0-163babe85658 req-525d83ae-93c9-49b7-9630-09e9dde96bbb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:17.459762 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-310dc2d2-76f9-4b00-b0c0-163babe85658 req-525d83ae-93c9-49b7-9630-09e9dde96bbb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 944 time: 0.0752778 Dec 08 11:33:17.467807 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-613bd5b4-f80a-4e74-b7b8-511ba4e5552a req-c2311099-b221-4382-ba37-eeb30c4039c5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:17.469181 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-613bd5b4-f80a-4e74-b7b8-511ba4e5552a req-c2311099-b221-4382-ba37-eeb30c4039c5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 943 time: 0.0757561 Dec 08 11:33:17.486505 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:17.499646 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6487232e-a2f6-40ee-bcd9-a49395653c34 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:33:17.528916 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 6487232e-a2f6-40ee-bcd9-a49395653c34, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=6487232e-a2f6-40ee-bcd9-a49395653c34,segment=NetworkSegment(c37df7a5-94f5-4cf8-8161-23e912b124b9),segment_id=c37df7a5-94f5-4cf8-8161-23e912b124b9)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:17.534704 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:17.535480 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:33:17.540926 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:17.543412 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-310dc2d2-76f9-4b00-b0c0-163babe85658 req-86b21966-369a-4d08-a123-3ae116fa4ce7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732698 Dec 08 11:33:17.551810 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-613bd5b4-f80a-4e74-b7b8-511ba4e5552a req-ed62e193-d4fa-4445-b091-aef7389e4844 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0751495 Dec 08 11:33:17.627474 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=6487232e-a2f6-40ee-bcd9-a49395653c34,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:17.639532 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:17.639532 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:17.639838 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:17.640144 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:17.640484 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:17.640891 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:17.641143 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:17.641496 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:17.641820 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:17.642144 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:17.642470 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:17.642793 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:17.643113 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:17.687535 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:17.699009 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'port_id': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec', 'mac_address': 'fa:16:3e:cd:c1:66', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 289, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:33:17.740165 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:17.746322 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7a7b0a-3d20-4a5c-b158-c681ea3674dd req-c5f76070-4690-45fc-9eb9-28cd2c6cb358 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:17.747811 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3a7a7b0a-3d20-4a5c-b158-c681ea3674dd req-c5f76070-4690-45fc-9eb9-28cd2c6cb358 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 943 time: 0.0805349 Dec 08 11:33:17.752610 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:33:17.759966 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55def3bf-cea7-440e-90ca-cd36f967d15d req-00842b0a-c3d3-43e9-8c90-a9f73273779a tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:17.761421 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-55def3bf-cea7-440e-90ca-cd36f967d15d req-00842b0a-c3d3-43e9-8c90-a9f73273779a tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 944 time: 0.0661530 Dec 08 11:33:17.771883 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:17.776007 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:17.776710 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 1d5f08a0-9b25-48d8-a2ed-88647aec1670 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:33:17.831502 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3a7a7b0a-3d20-4a5c-b158-c681ea3674dd req-211a68d3-2512-4622-8459-5bf61668be21 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0691168 Dec 08 11:33:17.838686 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-55def3bf-cea7-440e-90ca-cd36f967d15d req-bb949a87-3791-4cf1-a2f8-c5b92a57b159 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694554 Dec 08 11:33:17.869193 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:17.913026 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 1d5f08a0-9b25-48d8-a2ed-88647aec1670, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=1d5f08a0-9b25-48d8-a2ed-88647aec1670,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:17.924227 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '1d5f08a0-9b25-48d8-a2ed-88647aec1670', 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919', 'port_id': '1d5f08a0-9b25-48d8-a2ed-88647aec1670', 'mac_address': 'fa:16:3e:cf:06:42', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 277, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd6b1fb0e-d38f-47ca-a647-53b824c47e76', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:33:17.959611 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:17.972067 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1d5f08a0-9b25-48d8-a2ed-88647aec1670 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:33:17.991447 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 1d5f08a0-9b25-48d8-a2ed-88647aec1670, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=1d5f08a0-9b25-48d8-a2ed-88647aec1670,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:17.995180 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:17.995820 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:33:18.084819 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=1d5f08a0-9b25-48d8-a2ed-88647aec1670,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:18.126914 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=96b6dc81-7654-48f5-ac3f-e3e4d35982b3,segment=NetworkSegment(aa890c2f-8ce4-49b3-a366-4788a314e043),segment_id=aa890c2f-8ce4-49b3-a366-4788a314e043)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:18.138626 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '96b6dc81-7654-48f5-ac3f-e3e4d35982b3', 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb', 'port_id': '96b6dc81-7654-48f5-ac3f-e3e4d35982b3', 'mac_address': 'fa:16:3e:44:b7:35', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 252, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59ab11c2-3db5-4069-afa6-b6f825d69316', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:33:18.173991 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:18.189240 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:33:18.209711 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=96b6dc81-7654-48f5-ac3f-e3e4d35982b3,segment=NetworkSegment(aa890c2f-8ce4-49b3-a366-4788a314e043),segment_id=aa890c2f-8ce4-49b3-a366-4788a314e043)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:18.213250 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:18.263665 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=96b6dc81-7654-48f5-ac3f-e3e4d35982b3,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:21.116902 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3f45ed2-0485-45ec-af80-ec819dc866f4 req-e9eac470-11c7-4695-a8c5-37c7d0ccdaf8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:21.118464 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a3f45ed2-0485-45ec-af80-ec819dc866f4 req-e9eac470-11c7-4695-a8c5-37c7d0ccdaf8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 944 time: 0.0808821 Dec 08 11:33:21.125823 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16288f23-e4fe-44a2-a8ea-83739fb2d67e req-be451fd5-520a-4f05-a7fe-0b36bf1e8481 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:21.127194 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-16288f23-e4fe-44a2-a8ea-83739fb2d67e req-be451fd5-520a-4f05-a7fe-0b36bf1e8481 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 944 time: 0.0883968 Dec 08 11:33:21.196810 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a3f45ed2-0485-45ec-af80-ec819dc866f4 req-931a22ed-a54b-4f84-bc66-c1d042833a3f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686734 Dec 08 11:33:21.203777 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-16288f23-e4fe-44a2-a8ea-83739fb2d67e req-aa9db170-ac9f-4c1f-920a-83be6f20486f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694468 Dec 08 11:33:21.330192 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a55553e-f2df-488d-9c06-4ce69da67b66 req-e7551a51-0d39-4d4c-815e-20bc923c7e34 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:21.331701 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8a55553e-f2df-488d-9c06-4ce69da67b66 req-e7551a51-0d39-4d4c-815e-20bc923c7e34 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 944 time: 0.0795093 Dec 08 11:33:21.339974 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2291630-c3dc-4ee9-9b1f-8eb9ce982ed0 req-a13b8a4b-f0eb-433e-9bef-42103a979d05 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:21.341406 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c2291630-c3dc-4ee9-9b1f-8eb9ce982ed0 req-a13b8a4b-f0eb-433e-9bef-42103a979d05 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 945 time: 0.0796373 Dec 08 11:33:21.410698 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8a55553e-f2df-488d-9c06-4ce69da67b66 req-d08f545f-7046-4b92-9d35-2f92fee57dfe tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683098 Dec 08 11:33:21.417990 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c2291630-c3dc-4ee9-9b1f-8eb9ce982ed0 req-01122a27-1510-4894-a314-8980550aefd5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0697720 Dec 08 11:33:21.524060 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device ec0c1efb-b1b3-47b8-91c5-b30707a7222f details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:33:21.618277 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port ec0c1efb-b1b3-47b8-91c5-b30707a7222f, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=ec0c1efb-b1b3-47b8-91c5-b30707a7222f,segment=NetworkSegment(aa890c2f-8ce4-49b3-a366-4788a314e043),segment_id=aa890c2f-8ce4-49b3-a366-4788a314e043)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:21.632585 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': 'ec0c1efb-b1b3-47b8-91c5-b30707a7222f', 'network_id': 'b799b290-99c1-4693-82cc-42bbd4d90adb', 'port_id': 'ec0c1efb-b1b3-47b8-91c5-b30707a7222f', 'mac_address': 'fa:16:3e:32:5e:fd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 252, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59ab11c2-3db5-4069-afa6-b6f825d69316', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:33:21.672848 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:21.685278 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ec0c1efb-b1b3-47b8-91c5-b30707a7222f {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:33:21.703889 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port ec0c1efb-b1b3-47b8-91c5-b30707a7222f, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=ec0c1efb-b1b3-47b8-91c5-b30707a7222f,segment=NetworkSegment(aa890c2f-8ce4-49b3-a366-4788a314e043),segment_id=aa890c2f-8ce4-49b3-a366-4788a314e043)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:21.708876 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:21.753009 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=ec0c1efb-b1b3-47b8-91c5-b30707a7222f,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:22.271200 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['7fe8b63d-f6cd-45dc-a53c-93b64cacfeec'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:33:22.343800 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e54aff4-a94f-4366-97ee-6a2d33b7fade req-b414010d-5738-4960-bb6a-50dc7cc822f6 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:22.345304 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4e54aff4-a94f-4366-97ee-6a2d33b7fade req-b414010d-5738-4960-bb6a-50dc7cc822f6 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 944 time: 0.0805197 Dec 08 11:33:22.353172 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['1d5f08a0-9b25-48d8-a2ed-88647aec1670'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:33:22.355038 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-288af7f0-5a6f-4da3-9403-952cd259fb7e req-16013270-930a-4705-bc2b-319a68064aa6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:22.356473 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-288af7f0-5a6f-4da3-9403-952cd259fb7e req-16013270-930a-4705-bc2b-319a68064aa6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 945 time: 0.0814927 Dec 08 11:33:22.385182 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['6487232e-a2f6-40ee-bcd9-a49395653c34'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:33:22.387032 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['96b6dc81-7654-48f5-ac3f-e3e4d35982b3'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:33:22.431844 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4e54aff4-a94f-4366-97ee-6a2d33b7fade req-9669cbb0-987b-4eb9-879e-09e6ca25d50f tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0743937 Dec 08 11:33:22.435608 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-288af7f0-5a6f-4da3-9403-952cd259fb7e req-ac6e7190-15fd-46de-a991-08edc791f3c4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708890 Dec 08 11:33:22.546855 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-8078cbe0-7405-45ab-818f-f520e5bab21a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:22.571753 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71212a7a-0cda-4cea-9766-9e9c3e3871f3 req-37a66f37-78b4-4a73-9993-8f8f6d4516c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:22.573261 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-71212a7a-0cda-4cea-9766-9e9c3e3871f3 req-37a66f37-78b4-4a73-9993-8f8f6d4516c0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 945 time: 0.0767238 Dec 08 11:33:22.585358 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d4ca2d-88a9-472a-95db-1fdf06621208 req-b390f125-289b-44dd-8001-e210cf30bd5c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:22.586810 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98d4ca2d-88a9-472a-95db-1fdf06621208 req-b390f125-289b-44dd-8001-e210cf30bd5c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 944 time: 0.0802479 Dec 08 11:33:22.662292 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-71212a7a-0cda-4cea-9766-9e9c3e3871f3 req-266d328e-4306-4a28-9076-c6ea2f0bfebc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0745027 Dec 08 11:33:22.666761 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98d4ca2d-88a9-472a-95db-1fdf06621208 req-404aaa29-7569-45e9-89ef-b0f960ccd62e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0733507 Dec 08 11:33:22.982726 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['ec0c1efb-b1b3-47b8-91c5-b30707a7222f'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:33:23.581481 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1e5f59e-5c39-4a88-bbd4-a69b5d97d4b4 req-b91bacad-52f2-40f6-ad7d-0ba36105aeee tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:23.583027 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c1e5f59e-5c39-4a88-bbd4-a69b5d97d4b4 req-b91bacad-52f2-40f6-ad7d-0ba36105aeee tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 944 time: 0.0788991 Dec 08 11:33:23.591541 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b8e6e51-0068-4474-9fe1-1623ad6890c1 req-284c29f2-49f0-4369-a8a1-aa15935abd1c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:23.592907 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b8e6e51-0068-4474-9fe1-1623ad6890c1 req-284c29f2-49f0-4369-a8a1-aa15935abd1c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 945 time: 0.0794423 Dec 08 11:33:23.661240 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c1e5f59e-5c39-4a88-bbd4-a69b5d97d4b4 req-ff43dc9a-cf68-46f3-a785-4f959ece179c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673282 Dec 08 11:33:23.668458 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b8e6e51-0068-4474-9fe1-1623ad6890c1 req-e94f2d7d-2fdf-46b9-b83a-6492614be80f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686543 Dec 08 11:33:23.808652 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5865bd5-07bf-4553-8b95-a8ef945f7bf9 req-0ac0a016-5139-465e-b487-2d4ada86b2b6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:23.810069 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5865bd5-07bf-4553-8b95-a8ef945f7bf9 req-0ac0a016-5139-465e-b487-2d4ada86b2b6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 944 time: 0.0698669 Dec 08 11:33:23.818175 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abc1a03b-1df8-4d21-b3f5-5cf462d98754 req-ebf735ca-1f44-4f88-9703-b2f0357b3f12 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:23.819551 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-abc1a03b-1df8-4d21-b3f5-5cf462d98754 req-ebf735ca-1f44-4f88-9703-b2f0357b3f12 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 945 time: 0.0887434 Dec 08 11:33:23.889735 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5865bd5-07bf-4553-8b95-a8ef945f7bf9 req-b5469968-84fc-4fcb-85f2-92a911fc4f00 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692279 Dec 08 11:33:23.893763 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-abc1a03b-1df8-4d21-b3f5-5cf462d98754 req-ff0f5cb6-ed1c-4da8-a8f8-231cc310c7e9 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672884 Dec 08 11:33:24.686991 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-f45ea1bf-90f1-4e5b-a384-bb4603793c45 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:24.809549 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de06dcd7-67e7-412f-a69b-736398b9f92d req-a0b91b5b-504c-4094-82b1-11e2c8f84811 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:24.810964 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-de06dcd7-67e7-412f-a69b-736398b9f92d req-a0b91b5b-504c-4094-82b1-11e2c8f84811 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 944 time: 0.0802574 Dec 08 11:33:24.819544 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa0782a-e0ec-452d-84b1-f144e320ee2a req-3b4b1d72-b236-4477-940b-8854036d025a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:24.820935 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-faa0782a-e0ec-452d-84b1-f144e320ee2a req-3b4b1d72-b236-4477-940b-8854036d025a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 945 time: 0.0812380 Dec 08 11:33:24.892084 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-de06dcd7-67e7-412f-a69b-736398b9f92d req-8d39aef1-28a8-450f-b582-1e62c793f718 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701711 Dec 08 11:33:24.895623 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-faa0782a-e0ec-452d-84b1-f144e320ee2a req-36a5bafa-aae5-47d5-a3a1-f148c82a42c0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681026 Dec 08 11:33:25.033877 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b856ddc2-12c1-4bb1-add8-bc2770fa2260 req-60e9b464-220a-46c4-bb99-327daf9e4cc2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:25.035367 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b856ddc2-12c1-4bb1-add8-bc2770fa2260 req-60e9b464-220a-46c4-bb99-327daf9e4cc2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 944 time: 0.0785215 Dec 08 11:33:25.042461 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2997790a-632d-4162-b4cf-03666d3df913 req-c0b289dc-b965-46de-8d4d-f36e2fe36b17 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:25.043797 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2997790a-632d-4162-b4cf-03666d3df913 req-c0b289dc-b965-46de-8d4d-f36e2fe36b17 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 945 time: 0.0782905 Dec 08 11:33:25.111369 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b856ddc2-12c1-4bb1-add8-bc2770fa2260 req-447c57d1-780d-4a06-bf1a-0780a88e307d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666304 Dec 08 11:33:25.118909 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2997790a-632d-4162-b4cf-03666d3df913 req-e833f908-76e7-4a33-a23b-288443ceb397 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0685732 Dec 08 11:33:25.560460 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 6487232e-a2f6-40ee-bcd9-a49395653c34 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:25.631650 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 6487232e-a2f6-40ee-bcd9-a49395653c34 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:33:25.635605 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 6487232e-a2f6-40ee-bcd9-a49395653c34 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:25.635975 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:25.714544 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:25.736023 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3c255cd4-9751-4e4f-883b-9399d6a8c37e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6487232e-a2f6-40ee-bcd9-a49395653c34'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:33:25.738323 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1d123ec4-f346-4080-b21d-a8a781ca4b8c" -d '{"events": [{"server_uuid": "3c255cd4-9751-4e4f-883b-9399d6a8c37e", "name": "network-vif-plugged", "status": "completed", "tag": "6487232e-a2f6-40ee-bcd9-a49395653c34"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:33:25.753028 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 6487232e-a2f6-40ee-bcd9-a49395653c34, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=6487232e-a2f6-40ee-bcd9-a49395653c34,segment=NetworkSegment(c37df7a5-94f5-4cf8-8161-23e912b124b9),segment_id=c37df7a5-94f5-4cf8-8161-23e912b124b9)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:25.760298 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:25.761041 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:25.803559 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:25.836124 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:33:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7051532d-f99a-4371-a5e8-59b81fea2c75 x-openstack-request-id: req-7051532d-f99a-4371-a5e8-59b81fea2c75 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:33:25.836442 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3c255cd4-9751-4e4f-883b-9399d6a8c37e", "name": "network-vif-plugged", "status": "completed", "tag": "6487232e-a2f6-40ee-bcd9-a49395653c34", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:33:25.836703 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-7051532d-f99a-4371-a5e8-59b81fea2c75 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:33:25.837091 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3c255cd4-9751-4e4f-883b-9399d6a8c37e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6487232e-a2f6-40ee-bcd9-a49395653c34', 'code': 200} Dec 08 11:33:25.849773 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=6487232e-a2f6-40ee-bcd9-a49395653c34,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:25.864379 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:33:25.868362 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:25.868729 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:25.964350 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:25.980959 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-f3747870-a63c-46ab-9edc-ec5a31e61163 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:25.982461 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-f3747870-a63c-46ab-9edc-ec5a31e61163 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/networks?id=a19166f1-a36a-4f08-8a61-f4d3fa1e8383 HTTP/1.1" status: 200 len: 814 time: 0.1183593 Dec 08 11:33:25.997588 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:26.002293 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:26.018064 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-b6a791d7-a75c-4909-a160-bf87c60a9e01 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/quotas/b1b41ae149164acbb31b021c9049b500 HTTP/1.1" status: 200 len: 375 time: 0.0260866 Dec 08 11:33:26.051937 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:26.074313 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58325684-41b6-4665-a4d2-92f33f7d9f3c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=b1b41ae149164acbb31b021c9049b500&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0425158 Dec 08 11:33:26.092892 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94b03cb8-0a8a-4301-9e0f-57983de82016 req-d7cec940-a142-4909-9ee7-fd3be92ec28d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:26.094352 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-94b03cb8-0a8a-4301-9e0f-57983de82016 req-d7cec940-a142-4909-9ee7-fd3be92ec28d tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 945 time: 0.1110139 Dec 08 11:33:26.145802 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04458249-efe2-4ec4-b4db-ba3c1e54a331 req-4e443410-01cf-402d-b970-4800a0e93477 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:26.147216 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-04458249-efe2-4ec4-b4db-ba3c1e54a331 req-4e443410-01cf-402d-b970-4800a0e93477 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 1098 time: 0.1249874 Dec 08 11:33:26.232460 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-04458249-efe2-4ec4-b4db-ba3c1e54a331 req-7815860d-0542-4820-bc44-a92a3847d3bf service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0758855 Dec 08 11:33:26.238958 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-94b03cb8-0a8a-4301-9e0f-57983de82016 req-6053f3d8-7501-4273-b924-6aa76a515364 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1349525 Dec 08 11:33:26.250035 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-519a49d5-9a54-4817-a563-964fc585ad55 service neutron] 10.222.0.66 "GET /v2.0/networks/a19166f1-a36a-4f08-8a61-f4d3fa1e8383?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1649656 Dec 08 11:33:26.377345 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-318a5b31-b0af-44a2-9d74-ab727411f782 req-ff2f21ea-94f1-4ea3-8f4c-b94806997f2d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:26.379452 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-318a5b31-b0af-44a2-9d74-ab727411f782 req-ff2f21ea-94f1-4ea3-8f4c-b94806997f2d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 945 time: 0.0761838 Dec 08 11:33:26.383125 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-e52e0f36-be55-4a39-a59d-b9a4adb44daf service neutron] 10.222.0.66 "GET /v2.0/networks/a19166f1-a36a-4f08-8a61-f4d3fa1e8383?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1259594 Dec 08 11:33:26.427859 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-318a5b31-b0af-44a2-9d74-ab727411f782 req-7008efcb-2dea-4b5b-a04c-9351b000d880 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424683 Dec 08 11:33:26.532688 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-147a5284-69ae-49aa-99ce-9acbc256d46f req-63cab2df-a7ed-4374-a8db-ed9772c33cf1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:26.534213 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-147a5284-69ae-49aa-99ce-9acbc256d46f req-63cab2df-a7ed-4374-a8db-ed9772c33cf1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 944 time: 0.0504076 Dec 08 11:33:26.612494 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24336664-8bab-4aae-a816-4ed6963bfe68 req-3156f4d9-1b44-4964-9d36-c5d52d0f3efa tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:26.614541 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-24336664-8bab-4aae-a816-4ed6963bfe68 req-3156f4d9-1b44-4964-9d36-c5d52d0f3efa tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 946 time: 0.0793626 Dec 08 11:33:26.619164 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-147a5284-69ae-49aa-99ce-9acbc256d46f req-cecc6407-03e8-42b8-be0d-f90d236e8cd4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0747774 Dec 08 11:33:26.670592 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-24336664-8bab-4aae-a816-4ed6963bfe68 req-84135372-e16b-44a9-aaec-a080e716c4e0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499504 Dec 08 11:33:26.698844 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1a4d61c7-f5c5-4468-93be-24c385766c6e req-a9a58d35-44ed-409b-8a7f-9064cc3c2385 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 210 time: 0.0330682 Dec 08 11:33:27.120282 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:27.354330 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-243b182d-56f8-4676-86b2-abc2a8591d54 req-ee032e4c-7bfb-443b-a435-23647e779655 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:27.355774 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-243b182d-56f8-4676-86b2-abc2a8591d54 req-ee032e4c-7bfb-443b-a435-23647e779655 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 945 time: 0.0482368 Dec 08 11:33:27.405250 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-243b182d-56f8-4676-86b2-abc2a8591d54 req-d63980ec-6ab7-47e2-beb2-0c2da95db8dd tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435019 Dec 08 11:33:27.563560 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 1d5f08a0-9b25-48d8-a2ed-88647aec1670 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:27.590904 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-442dc498-a25f-43c8-a935-a574fa84565c req-2f35aebc-bf05-4caf-ae01-4c898cf44555 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:27.592439 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-442dc498-a25f-43c8-a935-a574fa84565c req-2f35aebc-bf05-4caf-ae01-4c898cf44555 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 945 time: 0.0954411 Dec 08 11:33:27.620185 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 1d5f08a0-9b25-48d8-a2ed-88647aec1670 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:33:27.625129 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 1d5f08a0-9b25-48d8-a2ed-88647aec1670 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:27.625594 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:27.693144 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-6c0f3316-17ff-44bb-8a0e-66121553f967 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:27.696288 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-6c0f3316-17ff-44bb-8a0e-66121553f967 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.61 "GET /v2.0/networks?id=a19166f1-a36a-4f08-8a61-f4d3fa1e8383 HTTP/1.1" status: 200 len: 814 time: 0.1730409 Dec 08 11:33:27.701650 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-442dc498-a25f-43c8-a935-a574fa84565c req-5484b631-ce31-4184-96ff-f8b4f69d572a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1015997 Dec 08 11:33:27.717257 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-90f31582-e3a4-4990-82c0-92fe28f798c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Request body: {'port': {'device_id': '9350ab5c-81eb-4a90-8a3b-266dc3794bb9', 'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383', 'admin_state_up': True, 'tenant_id': 'b1b41ae149164acbb31b021c9049b500'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:27.828208 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a12db327-b4a7-4777-ac45-c206282063ed req-3524c24c-ee77-4706-b1a2-8fc0f38d1946 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:27.829721 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a12db327-b4a7-4777-ac45-c206282063ed req-3524c24c-ee77-4706-b1a2-8fc0f38d1946 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 944 time: 0.1271689 Dec 08 11:33:27.837514 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:27.840043 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:33:27.849058 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b8638c46-243a-4179-8393-a19989b00064" -d '{"events": [{"server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "name": "network-vif-plugged", "status": "completed", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:33:27.877298 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 1d5f08a0-9b25-48d8-a2ed-88647aec1670, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=1d5f08a0-9b25-48d8-a2ed-88647aec1670,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:27.881983 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:27.882781 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:27.932116 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d85618a-e31d-46f7-a3c4-4467312652b8 req-112f6573-b701-405d-9b16-ec8ccd9e5656 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:27.933665 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d85618a-e31d-46f7-a3c4-4467312652b8 req-112f6573-b701-405d-9b16-ec8ccd9e5656 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 946 time: 0.1350584 Dec 08 11:33:27.939425 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a12db327-b4a7-4777-ac45-c206282063ed req-39d9a69e-fb88-4da6-8478-271b05d26786 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0912001 Dec 08 11:33:27.952677 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-90f31582-e3a4-4990-82c0-92fe28f798c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Made reservation on behalf of b1b41ae149164acbb31b021c9049b500 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:33:27.956911 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-90f31582-e3a4-4990-82c0-92fe28f798c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:27.973411 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=1d5f08a0-9b25-48d8-a2ed-88647aec1670,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:27.989817 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:33:27.995283 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:27.996263 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:28.057603 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d85618a-e31d-46f7-a3c4-4467312652b8 req-2c2055c6-499d-4b54-9eec-18d7c6fdac8a tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1127143 Dec 08 11:33:28.084028 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-922ade55-9eca-46f5-a083-e92ef38da773 req-f8ad5db6-3c8c-4321-9701-52027efe3051 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 210 time: 0.0451772 Dec 08 11:33:28.115843 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:28.162511 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-90f31582-e3a4-4990-82c0-92fe28f798c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Allocated IP 172.20.0.9 (a19166f1-a36a-4f08-8a61-f4d3fa1e8383/095735e3-fae9-450c-a1b3-5a4932e6f812/111e4836-2539-424a-86c3-da84a2a2dc76) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:33:28.168138 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:28.199260 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=96b6dc81-7654-48f5-ac3f-e3e4d35982b3,segment=NetworkSegment(aa890c2f-8ce4-49b3-a366-4788a314e043),segment_id=aa890c2f-8ce4-49b3-a366-4788a314e043)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:28.207721 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:28.209417 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device ec0c1efb-b1b3-47b8-91c5-b30707a7222f up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:28.300425 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:33:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f6d9ca75-d7b3-4f71-91b4-c3ce184b5695 x-openstack-request-id: req-f6d9ca75-d7b3-4f71-91b4-c3ce184b5695 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:33:28.300796 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "name": "network-vif-plugged", "status": "completed", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:33:28.301070 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-f6d9ca75-d7b3-4f71-91b4-c3ce184b5695 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:33:28.301395 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec', 'code': 200} Dec 08 11:33:28.346404 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=96b6dc81-7654-48f5-ac3f-e3e4d35982b3,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:28.365227 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port ec0c1efb-b1b3-47b8-91c5-b30707a7222f completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:33:28.369716 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port ec0c1efb-b1b3-47b8-91c5-b30707a7222f triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:28.370091 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:28.379665 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-90f31582-e3a4-4990-82c0-92fe28f798c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:28.414018 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-90f31582-e3a4-4990-82c0-92fe28f798c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:28.459676 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:28.460312 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-90f31582-e3a4-4990-82c0-92fe28f798c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Network a19166f1-a36a-4f08-8a61-f4d3fa1e8383 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:33:28.473735 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-90f31582-e3a4-4990-82c0-92fe28f798c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:28.492083 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-90f31582-e3a4-4990-82c0-92fe28f798c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:33:28.495246 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port ec0c1efb-b1b3-47b8-91c5-b30707a7222f, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=ec0c1efb-b1b3-47b8-91c5-b30707a7222f,segment=NetworkSegment(aa890c2f-8ce4-49b3-a366-4788a314e043),segment_id=aa890c2f-8ce4-49b3-a366-4788a314e043)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:28.499690 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:28.549334 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=ec0c1efb-b1b3-47b8-91c5-b30707a7222f,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:28.556469 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f31582-e3a4-4990-82c0-92fe28f798c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Pushing event updated for resources: {'Port': ['ID=111e4836-2539-424a-86c3-da84a2a2dc76,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:28.589535 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-90f31582-e3a4-4990-82c0-92fe28f798c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:28.590153 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-90f31582-e3a4-4990-82c0-92fe28f798c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:28.596596 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d68f50a-cf1b-4dc7-8607-f3a11f65ef11 req-02cd7af5-2fce-48c9-a69c-52353d48e119 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:28.598580 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2d68f50a-cf1b-4dc7-8607-f3a11f65ef11 req-02cd7af5-2fce-48c9-a69c-52353d48e119 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 1099 time: 0.1372166 Dec 08 11:33:28.616034 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f259267-aa46-4d4d-9411-31054df9ad43 req-df0fb586-5d92-45e2-b152-821709c12a5c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:28.617451 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3f259267-aa46-4d4d-9411-31054df9ad43 req-df0fb586-5d92-45e2-b152-821709c12a5c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 945 time: 0.1225846 Dec 08 11:33:28.628622 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-90f31582-e3a4-4990-82c0-92fe28f798c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9155326 Dec 08 11:33:28.653869 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Request body: {'port': {'device_id': '9350ab5c-81eb-4a90-8a3b-266dc3794bb9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:28.718952 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2d68f50a-cf1b-4dc7-8607-f3a11f65ef11 req-8e6a27e4-4c30-4146-8116-323035538d5f service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1107440 Dec 08 11:33:28.739434 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3f259267-aa46-4d4d-9411-31054df9ad43 req-cba2245a-de0c-4754-a37e-871d2a2c33f2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1156137 Dec 08 11:33:28.749910 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:28.905108 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc79d48f-8b83-464d-b2c5-933f6746f499 req-0e1b219e-8c92-4b98-8d67-375bd899129b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:28.906608 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dc79d48f-8b83-464d-b2c5-933f6746f499 req-0e1b219e-8c92-4b98-8d67-375bd899129b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1171050 Dec 08 11:33:29.015874 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dc79d48f-8b83-464d-b2c5-933f6746f499 req-d783a177-185a-4a6d-92db-b55664a2c298 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1021290 Dec 08 11:33:29.115028 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2efd0b47-35dd-41d3-af93-b70e9af17cac req-a37a97fb-9280-45e1-bff8-b516b2a1adee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:29.116660 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2efd0b47-35dd-41d3-af93-b70e9af17cac req-a37a97fb-9280-45e1-bff8-b516b2a1adee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 945 time: 0.0783169 Dec 08 11:33:29.419501 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 111e4836-2539-424a-86c3-da84a2a2dc76 {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:33:29.436692 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:29.466967 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2efd0b47-35dd-41d3-af93-b70e9af17cac req-951be891-6495-4e40-8e54-4ee9b2535a3b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1008263 Dec 08 11:33:29.468741 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Transition to ACTIVE for port object 111e4836-2539-424a-86c3-da84a2a2dc76 will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:33:29.494563 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5003547-fca0-4ae8-9f84-1f3b1605aa9d req-01792627-e8f8-458b-ab38-b43fc49af9bd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:29.494563 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a5003547-fca0-4ae8-9f84-1f3b1605aa9d req-01792627-e8f8-458b-ab38-b43fc49af9bd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 946 time: 0.1253450 Dec 08 11:33:29.494563 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:29.607060 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Pushing event updated for resources: {'Port': ['ID=111e4836-2539-424a-86c3-da84a2a2dc76,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:29.663493 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a5003547-fca0-4ae8-9f84-1f3b1605aa9d req-655f981a-4565-44fd-a48c-4774c81b4175 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1583769 Dec 08 11:33:29.694361 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-232b5622-01ed-47bc-b550-1536d049a2ef req-04041f0b-f0a3-4966-804b-09c9262810f1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:29.696800 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-232b5622-01ed-47bc-b550-1536d049a2ef req-04041f0b-f0a3-4966-804b-09c9262810f1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 943 time: 0.1517692 Dec 08 11:33:29.745028 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Attempting to bind port 111e4836-2539-424a-86c3-da84a2a2dc76 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:33:29.745398 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Attempting to bind port 111e4836-2539-424a-86c3-da84a2a2dc76 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': '93ea5ca7-22ef-4002-8579-aa09922044a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 269, 'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:33:29.745733 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Attempting to bind port 111e4836-2539-424a-86c3-da84a2a2dc76 on network a19166f1-a36a-4f08-8a61-f4d3fa1e8383 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:29.760474 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Port 111e4836-2539-424a-86c3-da84a2a2dc76 on network a19166f1-a36a-4f08-8a61-f4d3fa1e8383 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:33:29.760817 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Attempting to bind port 111e4836-2539-424a-86c3-da84a2a2dc76 on network a19166f1-a36a-4f08-8a61-f4d3fa1e8383 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:29.766594 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-232b5622-01ed-47bc-b550-1536d049a2ef req-b0c69419-db31-4916-a38e-a2a661fbd25e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0629394 Dec 08 11:33:29.769749 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 33, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:33:29.770090 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Checking segment: {'id': '93ea5ca7-22ef-4002-8579-aa09922044a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 269, 'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:33:29.770904 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Bound using segment: {'id': '93ea5ca7-22ef-4002-8579-aa09922044a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 269, 'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:33:29.770904 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Bound port: 111e4836-2539-424a-86c3-da84a2a2dc76, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '93ea5ca7-22ef-4002-8579-aa09922044a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 269, 'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:33:29.771240 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:29.860327 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] For port 111e4836-2539-424a-86c3-da84a2a2dc76, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:33:29.863972 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] For port 111e4836-2539-424a-86c3-da84a2a2dc76, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=111e4836-2539-424a-86c3-da84a2a2dc76,segment=NetworkSegment(93ea5ca7-22ef-4002-8579-aa09922044a7),segment_id=93ea5ca7-22ef-4002-8579-aa09922044a7)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:33:29.867544 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:29.900614 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:29.901437 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:29.902825 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] 10.222.0.61 "PUT /v2.0/ports/111e4836-2539-424a-86c3-da84a2a2dc76 HTTP/1.1" status: 200 len: 1093 time: 1.2541101 Dec 08 11:33:29.905425 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9350ab5c-81eb-4a90-8a3b-266dc3794bb9', 'tag': '111e4836-2539-424a-86c3-da84a2a2dc76'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:33:29.907506 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb" -d '{"events": [{"name": "network-changed", "server_uuid": "9350ab5c-81eb-4a90-8a3b-266dc3794bb9", "tag": "111e4836-2539-424a-86c3-da84a2a2dc76"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:33:29.935877 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58508e4a-d727-4bf4-9cef-0bc5ae6aa3c6 service neutron] Pushing event updated for resources: {'Port': ['ID=111e4836-2539-424a-86c3-da84a2a2dc76,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:29.979496 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:33:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e709b87-1176-4088-969e-11883df92f49 x-openstack-request-id: req-8e709b87-1176-4088-969e-11883df92f49 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:33:29.980448 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9350ab5c-81eb-4a90-8a3b-266dc3794bb9", "tag": "111e4836-2539-424a-86c3-da84a2a2dc76", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:33:29.980719 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-8e709b87-1176-4088-969e-11883df92f49 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:33:29.981126 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9350ab5c-81eb-4a90-8a3b-266dc3794bb9', 'tag': '111e4836-2539-424a-86c3-da84a2a2dc76', 'status': 'completed', 'code': 200} Dec 08 11:33:30.021908 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79453e7f-dce3-4b1a-b516-487c81c63e27 req-4e8def5c-ffcc-40e0-bc17-8a101343769c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:30.023368 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-79453e7f-dce3-4b1a-b516-487c81c63e27 req-4e8def5c-ffcc-40e0-bc17-8a101343769c tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 945 time: 0.0842011 Dec 08 11:33:30.029304 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-9b9e4008-e9b4-444f-bff0-1ac11e43b198 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:30.030636 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-9b9e4008-e9b4-444f-bff0-1ac11e43b198 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=b1b41ae149164acbb31b021c9049b500&device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 1096 time: 0.0641541 Dec 08 11:33:30.072551 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-79453e7f-dce3-4b1a-b516-487c81c63e27 req-14a1120b-3046-45e6-972f-8bc6cc72911e tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409627 Dec 08 11:33:30.132418 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0787b3f1-03f8-4b18-9527-ea04d89bfb33 req-50859ce8-b98d-4eca-a9a4-5a05a9af767a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:30.133889 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0787b3f1-03f8-4b18-9527-ea04d89bfb33 req-50859ce8-b98d-4eca-a9a4-5a05a9af767a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0471222 Dec 08 11:33:30.181306 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0787b3f1-03f8-4b18-9527-ea04d89bfb33 req-7ee8b74a-990f-4d31-8c83-fe5126234975 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414681 Dec 08 11:33:30.302039 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '96e47acb-aeed-4636-9a70-a1b987abaed6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1d5f08a0-9b25-48d8-a2ed-88647aec1670'}, {'server_uuid': 'ef74eb6c-4764-40c3-8610-e4f4bc3e610d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '96b6dc81-7654-48f5-ac3f-e3e4d35982b3'}, {'server_uuid': 'f4f33a56-55e3-4bc1-a952-b90b6fde964c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec0c1efb-b1b3-47b8-91c5-b30707a7222f'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:33:30.304349 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5aa2cd83-5cfd-4253-92cd-a0af85c3b04f" -d '{"events": [{"server_uuid": "96e47acb-aeed-4636-9a70-a1b987abaed6", "name": "network-vif-plugged", "status": "completed", "tag": "1d5f08a0-9b25-48d8-a2ed-88647aec1670"}, {"server_uuid": "ef74eb6c-4764-40c3-8610-e4f4bc3e610d", "name": "network-vif-plugged", "status": "completed", "tag": "96b6dc81-7654-48f5-ac3f-e3e4d35982b3"}, {"server_uuid": "f4f33a56-55e3-4bc1-a952-b90b6fde964c", "name": "network-vif-plugged", "status": "completed", "tag": "ec0c1efb-b1b3-47b8-91c5-b30707a7222f"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:33:30.346546 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 525 Content-Type: application/json Date: Wed, 08 Dec 2021 11:33:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e32f903d-ddfa-4233-a14d-01bf24722856 x-openstack-request-id: req-e32f903d-ddfa-4233-a14d-01bf24722856 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:33:30.346843 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "96e47acb-aeed-4636-9a70-a1b987abaed6", "name": "network-vif-plugged", "status": "completed", "tag": "1d5f08a0-9b25-48d8-a2ed-88647aec1670", "code": 200}, {"server_uuid": "ef74eb6c-4764-40c3-8610-e4f4bc3e610d", "name": "network-vif-plugged", "status": "completed", "tag": "96b6dc81-7654-48f5-ac3f-e3e4d35982b3", "code": 200}, {"server_uuid": "f4f33a56-55e3-4bc1-a952-b90b6fde964c", "name": "network-vif-plugged", "status": "completed", "tag": "ec0c1efb-b1b3-47b8-91c5-b30707a7222f", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:33:30.347673 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-e32f903d-ddfa-4233-a14d-01bf24722856 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:33:30.348122 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '96e47acb-aeed-4636-9a70-a1b987abaed6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1d5f08a0-9b25-48d8-a2ed-88647aec1670', 'code': 200} Dec 08 11:33:30.348379 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ef74eb6c-4764-40c3-8610-e4f4bc3e610d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '96b6dc81-7654-48f5-ac3f-e3e4d35982b3', 'code': 200} Dec 08 11:33:30.348632 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f4f33a56-55e3-4bc1-a952-b90b6fde964c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ec0c1efb-b1b3-47b8-91c5-b30707a7222f', 'code': 200} Dec 08 11:33:30.580447 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6cd1f06-cb25-4b8a-98e6-299dc9e70cec req-dde65f49-99ef-44a1-8bc8-cbcc4d46cd3c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:30.582595 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c6cd1f06-cb25-4b8a-98e6-299dc9e70cec req-dde65f49-99ef-44a1-8bc8-cbcc4d46cd3c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 945 time: 0.0484505 Dec 08 11:33:30.663039 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-cc3e9178-eba3-4040-b6bb-5762f7f03cc0 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=111e4836-2539-424a-86c3-da84a2a2dc76 HTTP/1.1" status: 200 len: 217 time: 0.0497091 Dec 08 11:33:30.666754 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c6cd1f06-cb25-4b8a-98e6-299dc9e70cec req-7a971715-c845-4743-8cae-5b12c801489e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780871 Dec 08 11:33:30.791660 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-10ea53bc-7bb3-43b6-b5bd-58f5240d8081 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:30.793018 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-10ea53bc-7bb3-43b6-b5bd-58f5240d8081 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=095735e3-fae9-450c-a1b3-5a4932e6f812 HTTP/1.1" status: 200 len: 854 time: 0.0953245 Dec 08 11:33:30.809249 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4769bd0-6ed1-4669-adb9-59e456bc56dc req-f5eb9e70-af73-474e-aaf8-aafcbb3ffd92 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:30.810684 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a4769bd0-6ed1-4669-adb9-59e456bc56dc req-f5eb9e70-af73-474e-aaf8-aafcbb3ffd92 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 946 time: 0.0638032 Dec 08 11:33:30.883592 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a4769bd0-6ed1-4669-adb9-59e456bc56dc req-50f2efd7-cdc8-4538-a911-8c363295b898 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662766 Dec 08 11:33:30.899469 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b8ce84-8c87-47f6-974d-a626f04ba531 req-242a6d3c-e481-4b13-9c29-849efe0515bb tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:30.900906 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1b8ce84-8c87-47f6-974d-a626f04ba531 req-242a6d3c-e481-4b13-9c29-849efe0515bb tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 943 time: 0.0640123 Dec 08 11:33:30.948803 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1b8ce84-8c87-47f6-974d-a626f04ba531 req-1beb15d6-0097-4209-bf95-d86397912dfa tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415459 Dec 08 11:33:33.895030 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:33:34.342535 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-d998b5e0-8f01-42d0-99dc-e511e868a0f8 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=a19166f1-a36a-4f08-8a61-f4d3fa1e8383&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0241332 Dec 08 11:33:34.418483 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd79dde4-045f-475a-87d0-3ddd84e483eb req-bdfdc243-6d13-4011-8764-a0ff9608a016 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:34.420255 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-cd79dde4-045f-475a-87d0-3ddd84e483eb req-bdfdc243-6d13-4011-8764-a0ff9608a016 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 1098 time: 0.0597458 Dec 08 11:33:34.474113 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [req-cd79dde4-045f-475a-87d0-3ddd84e483eb req-c98b574e-2562-4cd3-9281-1f9f993649d0 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453458 Dec 08 11:33:34.549029 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0804008a-947a-481c-b4c6-004d27ad9918 req-bd1feeaa-184c-4133-828f-ed46c3ab81e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:34.550713 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0804008a-947a-481c-b4c6-004d27ad9918 req-bd1feeaa-184c-4133-828f-ed46c3ab81e8 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 1099 time: 0.2063577 Dec 08 11:33:34.552351 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddcecbc1-da71-4ac6-b729-6f601a062827 req-d826d4a6-068a-4515-af7e-74af312c4dd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:34.553772 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ddcecbc1-da71-4ac6-b729-6f601a062827 req-d826d4a6-068a-4515-af7e-74af312c4dd5 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 1098 time: 0.2105165 Dec 08 11:33:34.585299 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fb0e29e-865e-406b-a527-903ba711fd38 req-cb647985-cd59-4d1a-bd73-6aee98112e30 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:34.586705 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1fb0e29e-865e-406b-a527-903ba711fd38 req-cb647985-cd59-4d1a-bd73-6aee98112e30 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 945 time: 0.1364410 Dec 08 11:33:34.595122 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950ff726-f199-470f-a284-36affd506d1a req-41e479c5-7d1b-424f-904f-a66e259283f4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:34.596410 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-950ff726-f199-470f-a284-36affd506d1a req-41e479c5-7d1b-424f-904f-a66e259283f4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1436474 Dec 08 11:33:34.600904 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-2a05a3c6-2a01-4803-a6a0-30d5b5db9935 service neutron] 10.222.0.61 "GET /v2.0/networks/a19166f1-a36a-4f08-8a61-f4d3fa1e8383?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2219238 Dec 08 11:33:34.670345 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1fb0e29e-865e-406b-a527-903ba711fd38 req-26938dab-aaf9-4762-83d6-0aec601465e9 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721629 Dec 08 11:33:34.673877 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-950ff726-f199-470f-a284-36affd506d1a req-4ab6420b-75d8-4771-842a-e1d06d104995 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0682597 Dec 08 11:33:34.802938 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51c4889e-5150-40a7-bce9-09e1a0fe166a req-66f8506c-6c82-41fe-83ee-fca55482c2b9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:34.804402 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-51c4889e-5150-40a7-bce9-09e1a0fe166a req-66f8506c-6c82-41fe-83ee-fca55482c2b9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 945 time: 0.0744045 Dec 08 11:33:34.824420 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e3d5ce6-b2e4-43e1-b18f-212e5a8ed868 req-dcc55e89-5457-441b-a605-2f16d1e2bd01 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:34.825807 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4e3d5ce6-b2e4-43e1-b18f-212e5a8ed868 req-dcc55e89-5457-441b-a605-2f16d1e2bd01 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 946 time: 0.0707300 Dec 08 11:33:34.886803 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-51c4889e-5150-40a7-bce9-09e1a0fe166a req-dd9930e2-6ad3-46a0-8ad9-70eab36dd22b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0749516 Dec 08 11:33:34.894353 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4e3d5ce6-b2e4-43e1-b18f-212e5a8ed868 req-b45a1f96-89c9-4f16-9670-34ea59173754 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602844 Dec 08 11:33:35.020032 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5b69ba-6310-4263-afba-b4d8f56798ce req-09cdfcd2-327e-4b97-bb99-912bcba1f1c3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:35.021517 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1d5b69ba-6310-4263-afba-b4d8f56798ce req-09cdfcd2-327e-4b97-bb99-912bcba1f1c3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 943 time: 0.0814655 Dec 08 11:33:35.032672 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd35e4b3-f458-478e-a68b-020f221f88e6 req-c77c990e-41b8-45c2-81f3-27d9f69544c7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:35.034089 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd35e4b3-f458-478e-a68b-020f221f88e6 req-c77c990e-41b8-45c2-81f3-27d9f69544c7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 946 time: 0.0646944 Dec 08 11:33:35.230160 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0804008a-947a-481c-b4c6-004d27ad9918 req-0cb7bff7-005a-467b-a1eb-ec5f884ab9e8 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1912189 Dec 08 11:33:35.233350 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1d5b69ba-6310-4263-afba-b4d8f56798ce req-b1b82687-c883-4822-8837-f71dfbd8d4f2 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1977301 Dec 08 11:33:35.241212 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ddcecbc1-da71-4ac6-b729-6f601a062827 req-b5015ed1-59a8-4548-8762-1e7617ea4186 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2034907 Dec 08 11:33:35.252996 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd35e4b3-f458-478e-a68b-020f221f88e6 req-13e9f193-295d-4758-938b-7dfa3d4970ca tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2121656 Dec 08 11:33:35.258405 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b1373c87-e5ef-4eee-8f6e-ce188fdb65e5 req-2bd43051-e654-41b8-a047-0b112d10fb24 service neutron] 10.222.0.61 "GET /v2.0/networks/a19166f1-a36a-4f08-8a61-f4d3fa1e8383?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2217624 Dec 08 11:33:36.181903 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-91a54a36-cbbe-4909-9869-56d0c224462a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:36.183428 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-91a54a36-cbbe-4909-9869-56d0c224462a service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=b1b41ae149164acbb31b021c9049b500&device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 1096 time: 0.1132360 Dec 08 11:33:36.209688 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a6e3187-5d5e-4d56-99d0-0696d5a266a1 req-253ffee5-2f6c-4a1f-8bad-712bce7451c5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:36.211514 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0a6e3187-5d5e-4d56-99d0-0696d5a266a1 req-253ffee5-2f6c-4a1f-8bad-712bce7451c5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 946 time: 0.1066363 Dec 08 11:33:36.259959 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-787e7c2e-cf42-41f9-a8ce-606c62ee2793 req-ba1152fe-069a-4de2-a0f6-c0185fd16933 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:36.261490 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-787e7c2e-cf42-41f9-a8ce-606c62ee2793 req-ba1152fe-069a-4de2-a0f6-c0185fd16933 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 945 time: 0.1230731 Dec 08 11:33:36.357793 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0a6e3187-5d5e-4d56-99d0-0696d5a266a1 req-1b5a05cd-4570-40b9-9bc2-d7432eb27e4d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1312490 Dec 08 11:33:36.367235 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-787e7c2e-cf42-41f9-a8ce-606c62ee2793 req-728737a6-d06a-4190-b046-d217c2e3faa2 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0974362 Dec 08 11:33:36.376866 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-a0eddae2-b437-4627-88d0-dc06bba25aaa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:36.379248 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-a0eddae2-b437-4627-88d0-dc06bba25aaa service neutron] 10.222.0.61 "GET /v2.0/networks?id=a19166f1-a36a-4f08-8a61-f4d3fa1e8383 HTTP/1.1" status: 200 len: 915 time: 0.1860197 Dec 08 11:33:36.427956 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-cf92d67a-4b6b-489b-a32b-8a6119fd663d service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=111e4836-2539-424a-86c3-da84a2a2dc76 HTTP/1.1" status: 200 len: 217 time: 0.0375867 Dec 08 11:33:36.535454 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-f40d4b82-ac56-4d23-887e-1373b2127fe9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:36.536929 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-f40d4b82-ac56-4d23-887e-1373b2127fe9 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=095735e3-fae9-450c-a1b3-5a4932e6f812 HTTP/1.1" status: 200 len: 854 time: 0.0986259 Dec 08 11:33:36.545981 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55cc6f4e-a318-48ea-a2de-957ee9983ba6 req-fee18bea-da91-424f-a7b4-bedc52eb7c2c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:36.547381 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-55cc6f4e-a318-48ea-a2de-957ee9983ba6 req-fee18bea-da91-424f-a7b4-bedc52eb7c2c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 945 time: 0.1100791 Dec 08 11:33:36.556222 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce9e001-8f25-4ec3-889a-9b59a057a927 req-9491ea44-9cb0-4bf4-9eb8-0ccd5f2b0c7b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:36.557727 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0ce9e001-8f25-4ec3-889a-9b59a057a927 req-9491ea44-9cb0-4bf4-9eb8-0ccd5f2b0c7b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1287601 Dec 08 11:33:36.592979 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-39cbd4d4-c0d6-425a-8c19-aafc7a1efeaa service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=a19166f1-a36a-4f08-8a61-f4d3fa1e8383&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0343597 Dec 08 11:33:36.707783 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-55cc6f4e-a318-48ea-a2de-957ee9983ba6 req-2b1b903c-43b2-495f-8cf5-4d15d847d78e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1417592 Dec 08 11:33:36.712561 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0ce9e001-8f25-4ec3-889a-9b59a057a927 req-8df0aac7-fa74-4369-95c2-4b9edeb634cb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1450164 Dec 08 11:33:36.741130 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-f441f526-d73a-42a6-809f-7aa38f7a76d3 service neutron] 10.222.0.61 "GET /v2.0/networks/a19166f1-a36a-4f08-8a61-f4d3fa1e8383?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1340008 Dec 08 11:33:36.861423 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c15eb56d-7bb4-4cf4-b8df-dd8c5a8dce79 req-47e69ef7-44db-4c1c-ab20-f674c6da96c7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:36.862823 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c15eb56d-7bb4-4cf4-b8df-dd8c5a8dce79 req-47e69ef7-44db-4c1c-ab20-f674c6da96c7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 943 time: 0.0919158 Dec 08 11:33:36.888587 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-46d7e508-8b70-4f6c-aeab-c55d8189a6bb req-8ff7a6d4-351d-4bbb-b14b-b36663e5534f service neutron] 10.222.0.61 "GET /v2.0/networks/a19166f1-a36a-4f08-8a61-f4d3fa1e8383?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1393929 Dec 08 11:33:36.918325 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c15eb56d-7bb4-4cf4-b8df-dd8c5a8dce79 req-b5f7e7e1-d94e-40d2-9e1e-2aae27db6727 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453696 Dec 08 11:33:37.497846 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf90388c-5a12-415f-b1f1-1ff4731d0e16 req-ee42376a-ea80-495e-b60b-16402ecace60 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:37.499300 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bf90388c-5a12-415f-b1f1-1ff4731d0e16 req-ee42376a-ea80-495e-b60b-16402ecace60 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 945 time: 0.0540109 Dec 08 11:33:37.547012 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bf90388c-5a12-415f-b1f1-1ff4731d0e16 req-e59edd87-4b6d-4ce9-bdd9-6093cc6ffbc7 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/security-groups?id=87031582-9f52-42b8-944f-dbb7215da8ae&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410683 Dec 08 11:33:37.651711 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc req-d56c9bf6-a2a5-42bf-8c05-1c56e6abc3b5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:37.653134 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc req-d56c9bf6-a2a5-42bf-8c05-1c56e6abc3b5 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.61 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 945 time: 0.0487370 Dec 08 11:33:37.784620 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc req-5a0ca0f0-71da-4edf-aa1c-8754f4b13bf8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Deleting port 6487232e-a2f6-40ee-bcd9-a49395653c34 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:33:37.784843 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc req-5a0ca0f0-71da-4edf-aa1c-8754f4b13bf8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:37.941294 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e5f11d8-b501-4512-a656-527e1fbefad4 req-6d9c9304-5421-4ae4-a3d5-93ba2e227ba0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:37.942784 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4e5f11d8-b501-4512-a656-527e1fbefad4 req-6d9c9304-5421-4ae4-a3d5-93ba2e227ba0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 945 time: 0.1317368 Dec 08 11:33:37.957691 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6258cf3d-f465-4e2d-a190-8f02362c6759 req-e71e3e9e-e392-4ded-9d65-022158d61a87 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:37.959122 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6258cf3d-f465-4e2d-a190-8f02362c6759 req-e71e3e9e-e392-4ded-9d65-022158d61a87 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1155028 Dec 08 11:33:37.985404 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc req-5a0ca0f0-71da-4edf-aa1c-8754f4b13bf8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] For port 6487232e-a2f6-40ee-bcd9-a49395653c34, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=6487232e-a2f6-40ee-bcd9-a49395653c34,segment=NetworkSegment(c37df7a5-94f5-4cf8-8161-23e912b124b9),segment_id=c37df7a5-94f5-4cf8-8161-23e912b124b9)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:37.985831 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc req-5a0ca0f0-71da-4edf-aa1c-8754f4b13bf8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:38.016226 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc req-5a0ca0f0-71da-4edf-aa1c-8754f4b13bf8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Calling delete_port for 6487232e-a2f6-40ee-bcd9-a49395653c34 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:33:38.089690 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6258cf3d-f465-4e2d-a190-8f02362c6759 req-95bf3727-5199-4afd-b2ce-ee41048dc60f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1239758 Dec 08 11:33:38.099958 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4e5f11d8-b501-4512-a656-527e1fbefad4 req-7ea4c6cb-29df-437e-bf83-4d8b70f3095f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1353567 Dec 08 11:33:38.225321 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc req-5a0ca0f0-71da-4edf-aa1c-8754f4b13bf8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:38.238794 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['6487232e-a2f6-40ee-bcd9-a49395653c34'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:33:38.275545 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a0ca0f0-71da-4edf-aa1c-8754f4b13bf8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Pushing event deleted for resources: {'Port': ['ID=6487232e-a2f6-40ee-bcd9-a49395653c34,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:38.317830 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd4c4586-17ef-4144-baf8-d63982b6ab1a req-5b6a2ccd-f245-40ab-8989-d415aba4de84 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:38.319357 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd4c4586-17ef-4144-baf8-d63982b6ab1a req-5b6a2ccd-f245-40ab-8989-d415aba4de84 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 943 time: 0.1054080 Dec 08 11:33:38.566048 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc req-5a0ca0f0-71da-4edf-aa1c-8754f4b13bf8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] No DVR routers for this DVR port 6487232e-a2f6-40ee-bcd9-a49395653c34 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:33:38.574329 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc req-5a0ca0f0-71da-4edf-aa1c-8754f4b13bf8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:38.577536 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dcd7ba7f-d172-49bd-bf5b-48d84bde0ebc req-5a0ca0f0-71da-4edf-aa1c-8754f4b13bf8 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.61 "DELETE /v2.0/ports/6487232e-a2f6-40ee-bcd9-a49395653c34 HTTP/1.1" status: 204 len: 173 time: 0.9128013 Dec 08 11:33:38.578278 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3c255cd4-9751-4e4f-883b-9399d6a8c37e', 'name': 'network-vif-deleted', 'tag': '6487232e-a2f6-40ee-bcd9-a49395653c34'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:33:38.580461 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6e3aac5-8f01-448b-a832-c6071184cd71" -d '{"events": [{"server_uuid": "3c255cd4-9751-4e4f-883b-9399d6a8c37e", "name": "network-vif-deleted", "tag": "6487232e-a2f6-40ee-bcd9-a49395653c34"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:33:38.624337 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd4c4586-17ef-4144-baf8-d63982b6ab1a req-f9280308-d9e4-4539-9031-a0027bbece32 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595963 Dec 08 11:33:38.809367 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7c52429e-f325-4908-ab8f-dbf000cd9345 req-7c279868-d7d7-4f93-a950-4e2dbb0ebe52 tempest-VolumesActionsTest-1930269785 tempest-VolumesActionsTest-1930269785-project] 10.222.0.66 "GET /v2.0/ports?device_id=3c255cd4-9751-4e4f-883b-9399d6a8c37e HTTP/1.1" status: 200 len: 210 time: 0.0257702 Dec 08 11:33:38.817349 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:33:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ed31267-225d-4c0c-b7de-45c8a70cbad3 x-openstack-request-id: req-1ed31267-225d-4c0c-b7de-45c8a70cbad3 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:33:38.817648 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3c255cd4-9751-4e4f-883b-9399d6a8c37e", "name": "network-vif-deleted", "tag": "6487232e-a2f6-40ee-bcd9-a49395653c34", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:33:38.817899 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-1ed31267-225d-4c0c-b7de-45c8a70cbad3 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:33:38.818472 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3c255cd4-9751-4e4f-883b-9399d6a8c37e', 'name': 'network-vif-deleted', 'tag': '6487232e-a2f6-40ee-bcd9-a49395653c34', 'status': 'completed', 'code': 200} Dec 08 11:33:39.230559 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40c321ad-0bce-4493-aca6-de3fbfe03411 req-af54681a-1c37-4e2e-a03a-f1497bc2f927 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:39.232084 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-40c321ad-0bce-4493-aca6-de3fbfe03411 req-af54681a-1c37-4e2e-a03a-f1497bc2f927 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0489683 Dec 08 11:33:39.282108 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-40c321ad-0bce-4493-aca6-de3fbfe03411 req-24d81de5-276a-4329-bea6-792babee72e7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426126 Dec 08 11:33:39.576930 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9150f6f-b182-4a93-b65a-2976295ed25b req-e7cff282-85c8-44d5-8146-d8d386798283 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:39.579047 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d9150f6f-b182-4a93-b65a-2976295ed25b req-e7cff282-85c8-44d5-8146-d8d386798283 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0828378 Dec 08 11:33:39.583501 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee2ea17-4079-4075-9452-0413ec330ef2 req-3e1a69ee-4850-41ae-99d5-5f4086550327 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:39.584519 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5ee2ea17-4079-4075-9452-0413ec330ef2 req-3e1a69ee-4850-41ae-99d5-5f4086550327 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=801ccccb4d7647de8e9558e07ebdc070&device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 1099 time: 0.0774264 Dec 08 11:33:39.600952 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 111e4836-2539-424a-86c3-da84a2a2dc76 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:33:39.684906 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d9150f6f-b182-4a93-b65a-2976295ed25b req-e9fe1d11-2b38-4ec2-aedd-091a4167205d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0946612 Dec 08 11:33:39.697778 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 111e4836-2539-424a-86c3-da84a2a2dc76, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=111e4836-2539-424a-86c3-da84a2a2dc76,segment=NetworkSegment(93ea5ca7-22ef-4002-8579-aa09922044a7),segment_id=93ea5ca7-22ef-4002-8579-aa09922044a7)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:39.710933 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '111e4836-2539-424a-86c3-da84a2a2dc76', 'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383', 'port_id': '111e4836-2539-424a-86c3-da84a2a2dc76', 'mac_address': 'fa:16:3e:0b:4d:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 269, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '095735e3-fae9-450c-a1b3-5a4932e6f812', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:33:39.714324 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee2ea17-4079-4075-9452-0413ec330ef2 req-f315808a-490f-4eed-b065-357c512dba92 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:39.715775 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5ee2ea17-4079-4075-9452-0413ec330ef2 req-f315808a-490f-4eed-b065-357c512dba92 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b799b290-99c1-4693-82cc-42bbd4d90adb HTTP/1.1" status: 200 len: 920 time: 0.1168921 Dec 08 11:33:39.756311 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:39.770283 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 111e4836-2539-424a-86c3-da84a2a2dc76 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:33:39.780487 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5ee2ea17-4079-4075-9452-0413ec330ef2 req-2945743a-9564-4b61-9bc1-c21ddd28f6d0 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=ec0c1efb-b1b3-47b8-91c5-b30707a7222f HTTP/1.1" status: 200 len: 217 time: 0.0508363 Dec 08 11:33:39.790769 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 111e4836-2539-424a-86c3-da84a2a2dc76, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=111e4836-2539-424a-86c3-da84a2a2dc76,segment=NetworkSegment(93ea5ca7-22ef-4002-8579-aa09922044a7),segment_id=93ea5ca7-22ef-4002-8579-aa09922044a7)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:39.794903 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:39.830382 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6495465b-ab30-4b98-8599-edd9fb712118 req-f589533b-6199-483c-9f85-bdbd96674d61 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:39.833898 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6495465b-ab30-4b98-8599-edd9fb712118 req-f589533b-6199-483c-9f85-bdbd96674d61 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 943 time: 0.1161435 Dec 08 11:33:39.843426 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=111e4836-2539-424a-86c3-da84a2a2dc76,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:39.864746 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee2ea17-4079-4075-9452-0413ec330ef2 req-61ed437c-c6d7-4e65-87e7-9bdd76580b37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:39.866230 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5ee2ea17-4079-4075-9452-0413ec330ef2 req-61ed437c-c6d7-4e65-87e7-9bdd76580b37 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59ab11c2-3db5-4069-afa6-b6f825d69316 HTTP/1.1" status: 200 len: 859 time: 0.0783439 Dec 08 11:33:39.907692 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5ee2ea17-4079-4075-9452-0413ec330ef2 req-f0fb2172-7a59-4cf2-9c23-d2b7c131a59e service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b799b290-99c1-4693-82cc-42bbd4d90adb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0307193 Dec 08 11:33:39.915337 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6495465b-ab30-4b98-8599-edd9fb712118 req-8cce448d-9044-4c66-a667-cdff44c3b5fd tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709043 Dec 08 11:33:40.012202 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5ee2ea17-4079-4075-9452-0413ec330ef2 req-61d38d77-215d-4e61-8e8d-71ca8ab5cc22 service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0914412 Dec 08 11:33:40.106105 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5ee2ea17-4079-4075-9452-0413ec330ef2 req-f8b4e35d-a674-426a-a6d1-f9b8eab2fbce service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854523 Dec 08 11:33:40.270958 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['111e4836-2539-424a-86c3-da84a2a2dc76'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:33:40.609470 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52580) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:40.719013 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5aa2033d-4ab6-4a07-a7ac-89493ff86252 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:40.794298 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5aa2033d-4ab6-4a07-a7ac-89493ff86252 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:40.798463 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5aa2033d-4ab6-4a07-a7ac-89493ff86252 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:40.813273 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b24faad-cca3-4449-bb18-8c8e73e7dd02 req-ac23cc35-afeb-482a-ad96-f41764cd7748 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:40.814841 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1b24faad-cca3-4449-bb18-8c8e73e7dd02 req-ac23cc35-afeb-482a-ad96-f41764cd7748 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0509634 Dec 08 11:33:40.837302 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aa2033d-4ab6-4a07-a7ac-89493ff86252 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=351f9864-796c-43f5-95ea-d2afb8d01683,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:40.845871 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-5aa2033d-4ab6-4a07-a7ac-89493ff86252 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=6733842f83724a56967e26f02b08658d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2357073 Dec 08 11:33:40.846466 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52592) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:40.869067 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1b24faad-cca3-4449-bb18-8c8e73e7dd02 req-3705841e-eb05-4937-8583-7910d18bf30a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427778 Dec 08 11:33:40.894665 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7e852934-44b2-444f-a2ce-1e651e68731c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:40.918531 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7e852934-44b2-444f-a2ce-1e651e68731c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:40.965309 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7e852934-44b2-444f-a2ce-1e651e68731c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:40.968034 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7e852934-44b2-444f-a2ce-1e651e68731c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:40.969245 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-7e852934-44b2-444f-a2ce-1e651e68731c admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/351f9864-796c-43f5-95ea-d2afb8d01683 HTTP/1.1" status: 204 len: 168 time: 0.1211398 Dec 08 11:33:40.977245 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e852934-44b2-444f-a2ce-1e651e68731c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=351f9864-796c-43f5-95ea-d2afb8d01683,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:41.571914 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52620) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:41.574798 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-432bf489-941c-49d8-ad3e-c57f41664709 req-5cc127a4-bbad-4b18-8675-99e756a5f349 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:41.576318 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-432bf489-941c-49d8-ad3e-c57f41664709 req-5cc127a4-bbad-4b18-8675-99e756a5f349 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 944 time: 0.0542235 Dec 08 11:33:41.623654 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-432bf489-941c-49d8-ad3e-c57f41664709 req-f84baf5b-ecac-4b69-b9c2-ee8024a74ccf tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407913 Dec 08 11:33:41.669019 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1020415369-network', 'tenant_id': '23027f58b51142389f64405702a0fcd3'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:41.689801 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Made reservation on behalf of 23027f58b51142389f64405702a0fcd3 for: {'network': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:33:41.692668 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:41.701239 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:41.774125 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:41.777675 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:41.798206 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] vlan segment allocate from pool success with {'vlan_id': 262, 'physical_network': 'physnet1'} {{(pid=102317) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:33:41.813657 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e6d8ccc-43be-4915-93e4-5436bd7a1993,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:41.816946 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:41.817444 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.segments_db [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Added segment 0f102544-c85b-462f-95c4-8c4e0e813aa2 of type vlan for network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 Dec 08 11:33:41.855960 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:41.879285 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:41.880187 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:41.880781 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:41.935743 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3627200 Dec 08 11:33:41.938903 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 52632) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:41.943041 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dff04e63-c23e-4072-8455-9fe3898be5eb admin admin] Pushing event updated for resources: {'Network': ['ID=55a129bc-8ce3-4aac-98fb-64f16c4a4949,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:41.945857 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-5a353fc3-c83a-4ea9-8b54-6989771e1531 admin admin] Request body: {'subnet': {'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1020415369-subnet', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'ip_version': 4}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:41.953374 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:33:41.993278 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a353fc3-c83a-4ea9-8b54-6989771e1531 admin admin] Made reservation on behalf of 23027f58b51142389f64405702a0fcd3 for: {'subnet': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:33:41.995559 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-5a353fc3-c83a-4ea9-8b54-6989771e1531 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-16496611'] for subnet, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.053749 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9bb75c3-2969-45ae-b000-3a26d24667c9 req-4d4a06f3-8f19-4709-bc87-22376d24deba tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:42.055144 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c9bb75c3-2969-45ae-b000-3a26d24667c9 req-4d4a06f3-8f19-4709-bc87-22376d24deba tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1129386 Dec 08 11:33:42.126402 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c9bb75c3-2969-45ae-b000-3a26d24667c9 req-2965a495-00a8-46bf-8676-2054c3fef32a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638952 Dec 08 11:33:42.211945 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-5a353fc3-c83a-4ea9-8b54-6989771e1531 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-4572227', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-16496629'] for subnet, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.272144 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a353fc3-c83a-4ea9-8b54-6989771e1531 admin admin] Pushing event updated for resources: {'Subnet': ['ID=59081569-032b-42c0-afce-26c79ceb7aac,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:42.280082 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5a353fc3-c83a-4ea9-8b54-6989771e1531 admin admin] Checking segment: {'id': '0f102544-c85b-462f-95c4-8c4e0e813aa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:33:42.280439 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a353fc3-c83a-4ea9-8b54-6989771e1531 admin admin] Network hostable DHCP agents. Network: 55a129bc-8ce3-4aac-98fb-64f16c4a4949, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102318) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:33:42.296690 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a353fc3-c83a-4ea9-8b54-6989771e1531 admin admin] Network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102318) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:33:42.305666 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-5a353fc3-c83a-4ea9-8b54-6989771e1531 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, 55a129bc-8ce3-4aac-98fb-64f16c4a4949) {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:42.310291 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a353fc3-c83a-4ea9-8b54-6989771e1531 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:42.311396 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-5a353fc3-c83a-4ea9-8b54-6989771e1531 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.314550 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5261c581-7e83-48b4-956f-5f7abc0d912e None None] Network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:33:42.328710 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-5a353fc3-c83a-4ea9-8b54-6989771e1531 admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3881760 Dec 08 11:33:42.331406 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 52634) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:42.335587 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:42.356396 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7895423', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32171'] for router, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.357661 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7895279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7889720', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7925360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32176'] for router, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.407549 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.417817 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp49d6adb3-88e2-5e36-b97e-28b28be9cdf8-55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'project_id': '23027f58b51142389f64405702a0fcd3', 'fixed_ips': [{'subnet_id': '59081569-032b-42c0-afce-26c79ceb7aac'}]}} from dv-cinder-819778-3-iscsi. {{(pid=102319) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 08 11:33:42.418683 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.548771 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.562336 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.db_base_plugin_common [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Allocated IP 172.20.0.2 (55a129bc-8ce3-4aac-98fb-64f16c4a4949/59081569-032b-42c0-afce-26c79ceb7aac/064410a8-b2e5-4789-9240-676ef2afbf8a) {{(pid=102319) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:33:42.711804 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Publish callbacks [] for port, precommit_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.719812 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.751219 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.757037 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 is already hosted by enough agents. {{(pid=102319) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:33:42.767222 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Pushing event updated for resources: {'Port': ['ID=064410a8-b2e5-4789-9240-676ef2afbf8a,revision_number=1']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:42.770785 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.base_scheduler [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Resources bound (agent type, host, resource id): {{(pid=102319) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:42.771390 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.774056 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 6487232e-a2f6-40ee-bcd9-a49395653c34 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:33:42.775960 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Received port after_create {{(pid=102319) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:33:42.798341 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 6487232e-a2f6-40ee-bcd9-a49395653c34 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:33:42.798672 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 6487232e-a2f6-40ee-bcd9-a49395653c34 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:33:42.850583 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Attempting to bind port 064410a8-b2e5-4789-9240-676ef2afbf8a on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:33:42.850955 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Attempting to bind port 064410a8-b2e5-4789-9240-676ef2afbf8a by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '0f102544-c85b-462f-95c4-8c4e0e813aa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:33:42.851305 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Attempting to bind port 064410a8-b2e5-4789-9240-676ef2afbf8a on network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:42.856293 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 33, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:33:42.856662 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Checking segment: {'id': '0f102544-c85b-462f-95c4-8c4e0e813aa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:33:42.857062 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.857486 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Bound using segment: {'id': '0f102544-c85b-462f-95c4-8c4e0e813aa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:33:42.857949 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Bound port: 064410a8-b2e5-4789-9240-676ef2afbf8a, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0f102544-c85b-462f-95c4-8c4e0e813aa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:33:42.858352 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.876645 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Allocated IP 172.27.2.18 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/e23bf4db-f0fa-4fe3-87ca-91680effc04b) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:33:42.919311 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] For port 064410a8-b2e5-4789-9240-676ef2afbf8a, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:33:42.922328 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] For port 064410a8-b2e5-4789-9240-676ef2afbf8a, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=064410a8-b2e5-4789-9240-676ef2afbf8a,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:33:42.927081 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:42.994056 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-024f9caa-62a3-4b8b-9570-3d8047116f7c None None] Pushing event updated for resources: {'Port': ['ID=064410a8-b2e5-4789-9240-676ef2afbf8a,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:42.997881 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:43.035014 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:43.073678 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:33:43.078625 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:43.082714 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:33:43.088403 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Pushing event updated for resources: {'Port': ['ID=e23bf4db-f0fa-4fe3-87ca-91680effc04b,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:43.341369 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:43.528239 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7895264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7889773'] for router, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:43.656943 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c is scheduled to L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f with binding_index 1 {{(pid=102318) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 08 11:33:43.771871 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:33:43.782577 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Sync routers for ids ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:33:43.791561 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] Publish callbacks [] for router, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:43.793196 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-0d7d8b2d-1353-4f76-ab38-22b4be56cc13 admin admin] 10.222.0.66 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 1.4604847 Dec 08 11:33:43.793333 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Routers {'3a9d62c0-7438-4191-89d6-70be7d9ccc6c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:33:43.793902 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:33:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:43.795670 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52658) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:43.887956 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c84f1b32-064f-4244-ae40-35b0d9062048 None None] Network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:33:43.970958 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-09fe2f30-3531-4e5f-aff4-44aa55c82f90 None None] Provisioning complete for port 064410a8-b2e5-4789-9240-676ef2afbf8a triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:43.972093 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-09fe2f30-3531-4e5f-aff4-44aa55c82f90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:43.989651 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Set router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:33:44.106821 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-09fe2f30-3531-4e5f-aff4-44aa55c82f90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.145461 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-09fe2f30-3531-4e5f-aff4-44aa55c82f90 None None] For port 064410a8-b2e5-4789-9240-676ef2afbf8a, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=064410a8-b2e5-4789-9240-676ef2afbf8a,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:44.156788 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-09fe2f30-3531-4e5f-aff4-44aa55c82f90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.183859 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:43Z', 'revision_number': 3, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port': {'id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:93:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 352, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:42Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:44.226915 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09fe2f30-3531-4e5f-aff4-44aa55c82f90 None None] Pushing event updated for resources: {'Port': ['ID=064410a8-b2e5-4789-9240-676ef2afbf8a,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:44.229735 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Checking router: 3a9d62c0-7438-4191-89d6-70be7d9ccc6c for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:33:44.230084 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Updating router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c port e23bf4db-f0fa-4fe3-87ca-91680effc04b binding host dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:33:44.263161 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.329376 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 064410a8-b2e5-4789-9240-676ef2afbf8a up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:44.387499 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-1ff66d3d-5803-453a-853e-9d8613039cde None None] Provisioning complete for port 064410a8-b2e5-4789-9240-676ef2afbf8a triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:44.387891 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1ff66d3d-5803-453a-853e-9d8613039cde None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.390588 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 064410a8-b2e5-4789-9240-676ef2afbf8a triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:44.390944 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.447555 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.525827 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Publish callbacks [] for port, precommit_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.532578 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.580435 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Attempting to bind port e23bf4db-f0fa-4fe3-87ca-91680effc04b on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:33:44.581463 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Attempting to bind port e23bf4db-f0fa-4fe3-87ca-91680effc04b by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:33:44.582062 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Attempting to bind port e23bf4db-f0fa-4fe3-87ca-91680effc04b on network d7cb3021-649a-44ca-b3a1-005b3941164e {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:44.592213 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 33, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:33:44.592583 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Checking segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102320) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:33:44.592978 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.593383 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Bound using segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:33:44.593835 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Bound port: e23bf4db-f0fa-4fe3-87ca-91680effc04b, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:33:44.594216 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.599637 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Pushing event updated for resources: {'Port': ['ID=e23bf4db-f0fa-4fe3-87ca-91680effc04b,revision_number=2']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:44.606043 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Allocated IP 172.20.0.1 (55a129bc-8ce3-4aac-98fb-64f16c4a4949/59081569-032b-42c0-afce-26c79ceb7aac/d5964107-ee0c-4bb0-ad4c-8179b4fa75a2) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:33:44.625829 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:44.626188 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:44.626540 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:44.626872 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:44.627195 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:44.627530 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:44.627855 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:44.628180 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:44.628486 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:44.628818 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:44.629140 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:44.629476 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:44.629786 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:33:44.660910 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] For port e23bf4db-f0fa-4fe3-87ca-91680effc04b, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102320) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:33:44.664915 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] For port e23bf4db-f0fa-4fe3-87ca-91680effc04b, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=e23bf4db-f0fa-4fe3-87ca-91680effc04b,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102320) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:33:44.669705 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.716119 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.723083 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Routers {'3a9d62c0-7438-4191-89d6-70be7d9ccc6c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:33:44.723701 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:33:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:44.749513 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.761429 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03548417-ba4b-4f78-bfd6-ff9f9b69d954 None None] Pushing event updated for resources: {'Port': ['ID=e23bf4db-f0fa-4fe3-87ca-91680effc04b,revision_number=3']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:44.788311 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:33:44.791039 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:44.793605 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:33:44.794240 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7898680'] for router_interface, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:44.832673 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] Set router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:33:44.891839 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Pushing event updated for resources: {'Port': ['ID=d5964107-ee0c-4bb0-ad4c-8179b4fa75a2,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:44.942148 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:45.022945 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:43Z', 'revision_number': 3, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port': {'id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:93:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 352, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:45.052458 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1820d788-2a9e-4050-829a-d8a826f77b37 None None] The sync data for ids ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'] in dv-cinder-819778-3-iscsi is: [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:43Z', 'revision_number': 3, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port': {'id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:93:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 352, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:33:45.053056 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fd1978a4-8786-4b96-b07b-5c8b4b48fd3d None None] Provisioning complete for port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:45.054206 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fd1978a4-8786-4b96-b07b-5c8b4b48fd3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:45.103264 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fd1978a4-8786-4b96-b07b-5c8b4b48fd3d None None] Port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:33:45.114206 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:45.118938 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:45.119627 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8074899', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7897000'] for router_interface, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:45.201932 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Pushing event updated for resources: {'Port': ['ID=d5964107-ee0c-4bb0-ad4c-8179b4fa75a2,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:45.246867 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:33:45.248322 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:45.382821 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:33:45.501790 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:33:45.507399 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-cfd6ee63-8d18-4a8f-8509-dd8232c157b8 admin admin] 10.222.0.66 "PUT /v2.0/routers/3a9d62c0-7438-4191-89d6-70be7d9ccc6c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7105439 Dec 08 11:33:45.530075 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-9e08dbc2-a60c-411c-bf00-68104f8a2bab None None] Provisioning complete for port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:45.531281 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9e08dbc2-a60c-411c-bf00-68104f8a2bab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:45.568690 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-9e08dbc2-a60c-411c-bf00-68104f8a2bab None None] Port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:33:45.893108 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d98b49e2-a79c-4dcf-9cfc-e5c83d2a5631 req-6343184f-2213-449d-92ff-2191230d0d79 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:45.897023 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d98b49e2-a79c-4dcf-9cfc-e5c83d2a5631 req-6343184f-2213-449d-92ff-2191230d0d79 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 944 time: 0.0879250 Dec 08 11:33:45.949660 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a4bcca9-acef-4cb2-9b66-0c3ce7237ca2 req-d60cc724-df08-4d65-8b48-b764951e96cb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:45.951232 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6a4bcca9-acef-4cb2-9b66-0c3ce7237ca2 req-d60cc724-df08-4d65-8b48-b764951e96cb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0974483 Dec 08 11:33:45.981691 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d98b49e2-a79c-4dcf-9cfc-e5c83d2a5631 req-b3326329-12ee-4d95-89ac-4e5be008920c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780902 Dec 08 11:33:46.014824 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6a4bcca9-acef-4cb2-9b66-0c3ce7237ca2 req-2fc38eb8-301e-4e13-b314-52ab4b418cdd tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554156 Dec 08 11:33:46.046699 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52686) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:46.052117 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-881503333-network', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:46.072958 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Made reservation on behalf of 20baef90cfd14c1eb1cc9cc518ab39b8 for: {'network': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:33:46.075372 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.086491 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.163086 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.167771 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.194671 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] vlan segment allocate from pool success with {'vlan_id': 286, 'physical_network': 'physnet1'} {{(pid=102317) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:33:46.200953 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=15975ea4-ee4a-42fb-b4f4-4bb97d00d1ae,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:46.207374 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.208148 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.segments_db [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Added segment 92b354b3-d3c3-4161-9c7f-a3df7bfcf34b of type vlan for network b60280a9-c9a1-4339-81c7-6d947b10537a Dec 08 11:33:46.253998 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.278931 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.279884 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:46.280471 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.328619 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.2808073 Dec 08 11:33:46.331265 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52688) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:46.335809 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-73df3c79-e6e5-499b-8b96-471b7081095b admin admin] Request body: {'subnet': {'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-881503333-subnet', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'ip_version': 4}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:46.347327 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 064410a8-b2e5-4789-9240-676ef2afbf8a up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:46.363505 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eb293fd-5c03-43ec-a519-c2f728c6813b admin admin] Pushing event updated for resources: {'Network': ['ID=b60280a9-c9a1-4339-81c7-6d947b10537a,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:46.374801 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-73df3c79-e6e5-499b-8b96-471b7081095b admin admin] Made reservation on behalf of 20baef90cfd14c1eb1cc9cc518ab39b8 for: {'subnet': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:33:46.376511 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network b60280a9-c9a1-4339-81c7-6d947b10537a details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:33:46.377288 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-73df3c79-e6e5-499b-8b96-471b7081095b admin admin] Publish callbacks [] for subnet, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.459440 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 064410a8-b2e5-4789-9240-676ef2afbf8a triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:46.460019 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.548144 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device e23bf4db-f0fa-4fe3-87ca-91680effc04b up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:46.551081 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-73df3c79-e6e5-499b-8b96-471b7081095b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for subnet, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.598578 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port e23bf4db-f0fa-4fe3-87ca-91680effc04b triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:46.598968 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.613720 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73df3c79-e6e5-499b-8b96-471b7081095b admin admin] Pushing event updated for resources: {'Subnet': ['ID=da2c65e5-a2e3-49fe-9217-53524b9f6c77,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:46.622831 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73df3c79-e6e5-499b-8b96-471b7081095b admin admin] Checking segment: {'id': '92b354b3-d3c3-4161-9c7f-a3df7bfcf34b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 286, 'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:33:46.622965 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73df3c79-e6e5-499b-8b96-471b7081095b admin admin] Network hostable DHCP agents. Network: b60280a9-c9a1-4339-81c7-6d947b10537a, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102317) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:33:46.639667 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73df3c79-e6e5-499b-8b96-471b7081095b admin admin] Network b60280a9-c9a1-4339-81c7-6d947b10537a is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102317) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:33:46.649763 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-73df3c79-e6e5-499b-8b96-471b7081095b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, b60280a9-c9a1-4339-81c7-6d947b10537a) {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:46.653822 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73df3c79-e6e5-499b-8b96-471b7081095b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:46.654422 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-73df3c79-e6e5-499b-8b96-471b7081095b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.666248 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-644c29ca-72c4-474e-aacc-77cf05679228 None None] Network b60280a9-c9a1-4339-81c7-6d947b10537a requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:33:46.676697 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-73df3c79-e6e5-499b-8b96-471b7081095b admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.3421361 Dec 08 11:33:46.677328 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52690) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:46.681367 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-881503333-router', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:46.712552 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7895423', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32171'] for router, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.714027 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7895279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7889720', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7925360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32176'] for router, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.804380 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.859718 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Sync routers for ids ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:33:46.871225 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:46.910012 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Routers {'3a9d62c0-7438-4191-89d6-70be7d9ccc6c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:33:46.910665 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:33:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:46.914929 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port e23bf4db-f0fa-4fe3-87ca-91680effc04b, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=e23bf4db-f0fa-4fe3-87ca-91680effc04b,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:46.959797 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:47.047187 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:47.108062 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp49d6adb3-88e2-5e36-b97e-28b28be9cdf8-b60280a9-c9a1-4339-81c7-6d947b10537a', 'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a', 'project_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'fixed_ips': [{'subnet_id': 'da2c65e5-a2e3-49fe-9217-53524b9f6c77'}]}} from dv-cinder-819778-3-iscsi. {{(pid=102319) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 08 11:33:47.109418 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:47.130917 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=e23bf4db-f0fa-4fe3-87ca-91680effc04b,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:47.200024 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3737c10-4110-4102-9505-a0fbadd8eb98 req-68d2e144-706f-4267-a9bc-d7d3350d2e8c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:47.207771 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e3737c10-4110-4102-9505-a0fbadd8eb98 req-68d2e144-706f-4267-a9bc-d7d3350d2e8c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 944 time: 0.1182730 Dec 08 11:33:47.260374 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-487f1a8d-934d-4b9c-b324-22c55ce9036a req-2d7609ff-9294-4708-84ab-0166d0f82743 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:47.262696 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Set router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:33:47.267668 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-487f1a8d-934d-4b9c-b324-22c55ce9036a req-2d7609ff-9294-4708-84ab-0166d0f82743 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1410875 Dec 08 11:33:47.289395 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e3737c10-4110-4102-9505-a0fbadd8eb98 req-470e4827-af85-4037-9d56-7530fad113a5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0754321 Dec 08 11:33:47.355517 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-487f1a8d-934d-4b9c-b324-22c55ce9036a req-ea63278c-b731-4f5c-a591-ae4dd8f29f5a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0857351 Dec 08 11:33:47.384307 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:47.407547 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:47.540790 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Allocated IP 172.27.2.38 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:33:47.557087 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.db_base_plugin_common [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Allocated IP 172.20.0.2 (b60280a9-c9a1-4339-81c7-6d947b10537a/da2c65e5-a2e3-49fe-9217-53524b9f6c77/cee6fedc-1958-4f00-867a-97fe064dffea) {{(pid=102319) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:33:47.581494 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:47.680144 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:47.684207 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:44Z', 'revision_number': 4, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port': {'id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:93:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 352, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': 'd5964107-ee0c-4bb0-ad4c-8179b4fa75a2', 'name': '', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'mac_address': 'fa:16:3e:a3:c7:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 353, 'fixed_ips': [{'subnet_id': '59081569-032b-42c0-afce-26c79ceb7aac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:44Z', 'updated_at': '2021-12-08T11:33:44Z', 'revision_number': 2, 'project_id': '23027f58b51142389f64405702a0fcd3', 'subnets': [{'id': '59081569-032b-42c0-afce-26c79ceb7aac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:47.719651 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:47.729391 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Checking router: 3a9d62c0-7438-4191-89d6-70be7d9ccc6c for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:33:47.729391 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Updating router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 binding host dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:33:47.757584 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:33:47.762221 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:47.764882 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:33:47.785748 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:47.818343 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Publish callbacks [] for port, precommit_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:47.844135 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 111e4836-2539-424a-86c3-da84a2a2dc76 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:47.878696 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:47.909462 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Pushing event updated for resources: {'Port': ['ID=fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:48.015437 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Network b60280a9-c9a1-4339-81c7-6d947b10537a is already hosted by enough agents. {{(pid=102319) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:33:48.024456 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Pushing event updated for resources: {'Port': ['ID=cee6fedc-1958-4f00-867a-97fe064dffea,revision_number=1']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:48.031170 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.base_scheduler [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Resources bound (agent type, host, resource id): {{(pid=102319) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:48.037241 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Received port after_create {{(pid=102319) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:33:48.178815 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 111e4836-2539-424a-86c3-da84a2a2dc76 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:33:48.203479 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 111e4836-2539-424a-86c3-da84a2a2dc76 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:48.203841 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:48.271388 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Attempting to bind port cee6fedc-1958-4f00-867a-97fe064dffea on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:33:48.271766 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Attempting to bind port cee6fedc-1958-4f00-867a-97fe064dffea by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '92b354b3-d3c3-4161-9c7f-a3df7bfcf34b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 286, 'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:33:48.272132 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Attempting to bind port cee6fedc-1958-4f00-867a-97fe064dffea on network b60280a9-c9a1-4339-81c7-6d947b10537a {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:48.294186 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 33, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:33:48.294608 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Checking segment: {'id': '92b354b3-d3c3-4161-9c7f-a3df7bfcf34b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 286, 'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:33:48.295021 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:48.295418 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Bound using segment: {'id': '92b354b3-d3c3-4161-9c7f-a3df7bfcf34b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 286, 'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:33:48.296032 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Bound port: cee6fedc-1958-4f00-867a-97fe064dffea, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '92b354b3-d3c3-4161-9c7f-a3df7bfcf34b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 286, 'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:33:48.296419 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:48.319460 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:48.364625 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device e23bf4db-f0fa-4fe3-87ca-91680effc04b up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:48.462008 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee2ed485-e708-4574-9118-5acfe3961aee req-12c753b8-bd07-4ea9-982b-064104bb4b65 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:48.464523 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ee2ed485-e708-4574-9118-5acfe3961aee req-12c753b8-bd07-4ea9-982b-064104bb4b65 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 944 time: 0.0705011 Dec 08 11:33:48.562287 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ee2ed485-e708-4574-9118-5acfe3961aee req-800f1d06-2e33-4b98-b2cc-630a76463d4f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582166 Dec 08 11:33:48.576557 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18ee4cba-3b5f-4787-8712-647611d967ca req-34f8c0d8-5d37-40db-9b78-765aa6f50963 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:48.580944 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-18ee4cba-3b5f-4787-8712-647611d967ca req-34f8c0d8-5d37-40db-9b78-765aa6f50963 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1092322 Dec 08 11:33:48.607351 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Publish callbacks [] for port, precommit_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:48.611688 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:48.619846 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7895264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7889773'] for router, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:48.631123 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] For port cee6fedc-1958-4f00-867a-97fe064dffea, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:33:48.644921 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] For port cee6fedc-1958-4f00-867a-97fe064dffea, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=cee6fedc-1958-4f00-867a-97fe064dffea,segment=NetworkSegment(92b354b3-d3c3-4161-9c7f-a3df7bfcf34b),segment_id=92b354b3-d3c3-4161-9c7f-a3df7bfcf34b)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:33:48.657351 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-18ee4cba-3b5f-4787-8712-647611d967ca req-221dce81-f04a-4423-984f-f2db1a4d8ddf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621841 Dec 08 11:33:48.676052 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 111e4836-2539-424a-86c3-da84a2a2dc76, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=111e4836-2539-424a-86c3-da84a2a2dc76,segment=NetworkSegment(93ea5ca7-22ef-4002-8579-aa09922044a7),segment_id=93ea5ca7-22ef-4002-8579-aa09922044a7)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:48.682043 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:48.691834 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9350ab5c-81eb-4a90-8a3b-266dc3794bb9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '111e4836-2539-424a-86c3-da84a2a2dc76'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:33:48.694696 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf6e6447-ebe2-49ce-be96-f64879f244c3" -d '{"events": [{"server_uuid": "9350ab5c-81eb-4a90-8a3b-266dc3794bb9", "name": "network-vif-plugged", "status": "completed", "tag": "111e4836-2539-424a-86c3-da84a2a2dc76"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:33:48.705853 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:48.769079 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port e23bf4db-f0fa-4fe3-87ca-91680effc04b triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:48.778219 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:48.792963 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:48.799670 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:33:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f5e9c32b-5e1b-45a6-95b0-8caba1a57e91 x-openstack-request-id: req-f5e9c32b-5e1b-45a6-95b0-8caba1a57e91 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:33:48.800262 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9350ab5c-81eb-4a90-8a3b-266dc3794bb9", "name": "network-vif-plugged", "status": "completed", "tag": "111e4836-2539-424a-86c3-da84a2a2dc76", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:33:48.800674 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-f5e9c32b-5e1b-45a6-95b0-8caba1a57e91 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:33:48.801252 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9350ab5c-81eb-4a90-8a3b-266dc3794bb9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '111e4836-2539-424a-86c3-da84a2a2dc76', 'code': 200} Dec 08 11:33:48.993788 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Router 613f8c98-e083-4296-b340-59fc1326e708 is scheduled to L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f with binding_index 1 {{(pid=102317) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 08 11:33:49.033859 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6723b4cb-a62b-4b30-bd1c-25290141ffaa None None] Pushing event updated for resources: {'Port': ['ID=d5964107-ee0c-4bb0-ad4c-8179b4fa75a2,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:49.187195 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6236a35-6540-4765-aa5a-31f4b13459e7 req-f95cff32-4f14-41d4-b370-25832545e938 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:49.188714 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b6236a35-6540-4765-aa5a-31f4b13459e7 req-f95cff32-4f14-41d4-b370-25832545e938 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 1098 time: 0.0742748 Dec 08 11:33:49.239718 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Attempting to bind port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:33:49.240216 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Attempting to bind port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '0f102544-c85b-462f-95c4-8c4e0e813aa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:33:49.240675 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Attempting to bind port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 on network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:49.261024 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 33, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:33:49.261607 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Checking segment: {'id': '0f102544-c85b-462f-95c4-8c4e0e813aa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:33:49.262361 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:49.263254 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Bound using segment: {'id': '0f102544-c85b-462f-95c4-8c4e0e813aa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:33:49.264138 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Bound port: d5964107-ee0c-4bb0-ad4c-8179b4fa75a2, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0f102544-c85b-462f-95c4-8c4e0e813aa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:33:49.265411 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:49.304892 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:33:49.324134 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Sync routers for ids ['613f8c98-e083-4296-b340-59fc1326e708'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:33:49.325562 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-9b9cfb61-8f29-4a2a-aa21-5c514e7285c8 None None] Provisioning complete for port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:49.326033 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9b9cfb61-8f29-4a2a-aa21-5c514e7285c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:49.332077 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a034d8-0cce-49f6-bdb7-6221d0c833fd None None] Pushing event updated for resources: {'Port': ['ID=cee6fedc-1958-4f00-867a-97fe064dffea,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:49.339965 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] Publish callbacks [] for router, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:49.344438 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-77339eed-b5f0-426c-887e-eceece4081b4 admin admin] 10.222.0.66 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 2.6631367 Dec 08 11:33:49.344438 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52756) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:49.358656 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Routers {'613f8c98-e083-4296-b340-59fc1326e708'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:33:49.362330 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:33:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['613f8c98-e083-4296-b340-59fc1326e708'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:49.370730 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b6236a35-6540-4765-aa5a-31f4b13459e7 req-024f8812-3619-46b3-b965-ad4394ee59d8 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1557004 Dec 08 11:33:49.490078 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Set router 613f8c98-e083-4296-b340-59fc1326e708 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:33:49.683957 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-9b9cfb61-8f29-4a2a-aa21-5c514e7285c8 None None] Port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:33:49.742248 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=111e4836-2539-424a-86c3-da84a2a2dc76,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:49.748603 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '613f8c98-e083-4296-b340-59fc1326e708', 'name': 'tempest-TestShelveInstance-881503333-router', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38'}], 'enable_snat': True}, 'gw_port_id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:46Z', 'updated_at': '2021-12-08T11:33:47Z', 'revision_number': 3, 'project_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'gw_port': {'id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:25:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '613f8c98-e083-4296-b340-59fc1326e708', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:47Z', 'updated_at': '2021-12-08T11:33:47Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:49.764216 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] For port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:33:49.776063 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] For port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=d5964107-ee0c-4bb0-ad4c-8179b4fa75a2,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:33:49.785081 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:49.833552 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Checking router: 613f8c98-e083-4296-b340-59fc1326e708 for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:33:49.833895 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Updating router 613f8c98-e083-4296-b340-59fc1326e708 port fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf binding host dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:33:49.893761 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:49.910944 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Routers {'3a9d62c0-7438-4191-89d6-70be7d9ccc6c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:33:49.921927 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:33:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:49.926595 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6723b4cb-a62b-4b30-bd1c-25290141ffaa None None] Pushing event updated for resources: {'Port': ['ID=d5964107-ee0c-4bb0-ad4c-8179b4fa75a2,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:49.974468 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0802e62b-e700-4041-bb66-4021a18cdc43 req-7cef02f9-9137-426f-9285-4e70f5c63a7c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:49.999768 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0802e62b-e700-4041-bb66-4021a18cdc43 req-7cef02f9-9137-426f-9285-4e70f5c63a7c tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 945 time: 0.2631469 Dec 08 11:33:50.073720 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-334362ea-910c-427c-86bc-746381cb4f58 req-1d0cc984-778c-45b8-8850-c1de2555f530 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:50.098849 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-334362ea-910c-427c-86bc-746381cb4f58 req-1d0cc984-778c-45b8-8850-c1de2555f530 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.2847390 Dec 08 11:33:50.212788 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0802e62b-e700-4041-bb66-4021a18cdc43 req-d3eaf9c0-ea03-42b0-ad24-f117abdb4c59 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2109275 Dec 08 11:33:50.310981 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] Set router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:33:50.319897 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-334362ea-910c-427c-86bc-746381cb4f58 req-02e8c3c8-46d7-46d9-b7fd-7d6bb6b8e38a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2198482 Dec 08 11:33:50.399140 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-9167a8df-0779-4a14-b17c-cce337c4046f None None] Provisioning complete for port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:50.399753 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9167a8df-0779-4a14-b17c-cce337c4046f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:50.452259 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:50.542184 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device cee6fedc-1958-4f00-867a-97fe064dffea up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:50.751036 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-988c2979-e74e-4386-a48c-21980bc3ec54 None None] Network b60280a9-c9a1-4339-81c7-6d947b10537a requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:33:50.770934 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Allocated IP 172.20.0.1 (b60280a9-c9a1-4339-81c7-6d947b10537a/da2c65e5-a2e3-49fe-9217-53524b9f6c77/cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:33:50.773462 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port cee6fedc-1958-4f00-867a-97fe064dffea triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:50.774059 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:50.802789 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Publish callbacks [] for port, precommit_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:50.816874 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:50.866808 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9167a8df-0779-4a14-b17c-cce337c4046f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:50.875956 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2d90ace-8cc3-4986-a724-cecf6443b0a2 None None] Pushing event updated for resources: {'Port': ['ID=fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf,revision_number=2']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:50.911392 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Attempting to bind port fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:33:50.912320 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Attempting to bind port fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:33:50.912884 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Attempting to bind port fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf on network d7cb3021-649a-44ca-b3a1-005b3941164e {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:50.921407 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 33, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:33:50.922138 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Checking segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102320) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:33:50.922755 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:50.923437 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Bound using segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:33:50.924152 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Bound port: fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:33:50.924782 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:50.932751 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:50.970031 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-9167a8df-0779-4a14-b17c-cce337c4046f None None] For port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=d5964107-ee0c-4bb0-ad4c-8179b4fa75a2,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:50.990410 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] For port fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102320) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:33:50.994568 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] For port fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102320) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:33:51.000484 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:51.006921 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:51.025652 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9167a8df-0779-4a14-b17c-cce337c4046f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:51.067853 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Network b60280a9-c9a1-4339-81c7-6d947b10537a is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:33:51.073062 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:51.083476 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:33:51.083937 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7898680'] for router_interface, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:51.115629 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:51.127922 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2d90ace-8cc3-4986-a724-cecf6443b0a2 None None] Pushing event updated for resources: {'Port': ['ID=fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf,revision_number=3']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:51.128164 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:44Z', 'revision_number': 4, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port': {'id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:93:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 352, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': 'd5964107-ee0c-4bb0-ad4c-8179b4fa75a2', 'name': '', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'mac_address': 'fa:16:3e:a3:c7:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 353, 'fixed_ips': [{'subnet_id': '59081569-032b-42c0-afce-26c79ceb7aac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:44Z', 'updated_at': '2021-12-08T11:33:49Z', 'revision_number': 4, 'project_id': '23027f58b51142389f64405702a0fcd3', 'subnets': [{'id': '59081569-032b-42c0-afce-26c79ceb7aac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:51.150324 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Routers {'613f8c98-e083-4296-b340-59fc1326e708'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:33:51.151389 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:33:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['613f8c98-e083-4296-b340-59fc1326e708'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:51.197781 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-586ac615-b644-4e0e-8de6-935bb9ffe60c None None] The sync data for ids ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'] in dv-cinder-819778-3-iscsi is: [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:44Z', 'revision_number': 4, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port': {'id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:93:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 352, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': 'd5964107-ee0c-4bb0-ad4c-8179b4fa75a2', 'name': '', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'mac_address': 'fa:16:3e:a3:c7:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 353, 'fixed_ips': [{'subnet_id': '59081569-032b-42c0-afce-26c79ceb7aac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:44Z', 'updated_at': '2021-12-08T11:33:49Z', 'revision_number': 4, 'project_id': '23027f58b51142389f64405702a0fcd3', 'subnets': [{'id': '59081569-032b-42c0-afce-26c79ceb7aac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:33:51.199673 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9167a8df-0779-4a14-b17c-cce337c4046f None None] Pushing event updated for resources: {'Port': ['ID=d5964107-ee0c-4bb0-ad4c-8179b4fa75a2,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:51.269546 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Pushing event updated for resources: {'Port': ['ID=cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:51.311984 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port cee6fedc-1958-4f00-867a-97fe064dffea, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=cee6fedc-1958-4f00-867a-97fe064dffea,segment=NetworkSegment(92b354b3-d3c3-4161-9c7f-a3df7bfcf34b),segment_id=92b354b3-d3c3-4161-9c7f-a3df7bfcf34b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:51.353543 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:51.459365 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:51.471078 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] Set router 613f8c98-e083-4296-b340-59fc1326e708 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:33:51.506839 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-f2d4a2a7-fbce-48a0-bcc7-6b749632ebc2 None None] Provisioning complete for port cee6fedc-1958-4f00-867a-97fe064dffea triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:51.507518 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-f2d4a2a7-fbce-48a0-bcc7-6b749632ebc2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:51.693742 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=cee6fedc-1958-4f00-867a-97fe064dffea,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:51.698413 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-204f36ce-e2cc-45d8-898e-2777e16b3eaa req-79c74229-2e37-44d9-95d6-204368598106 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:51.709359 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-204f36ce-e2cc-45d8-898e-2777e16b3eaa req-79c74229-2e37-44d9-95d6-204368598106 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 945 time: 0.1702363 Dec 08 11:33:51.755793 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4c2c871-6a89-4252-999b-fca8deda978d req-b7b37aaa-8167-4570-bf4f-65358f898aab tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:51.768069 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a4c2c871-6a89-4252-999b-fca8deda978d req-b7b37aaa-8167-4570-bf4f-65358f898aab tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.2456439 Dec 08 11:33:51.934661 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:51.947648 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:51.948474 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8074899', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7897000'] for router_interface, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:51.979139 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-4b3be52b-c9ee-4a5f-a7ab-0a297cd92729 None None] Provisioning complete for port cee6fedc-1958-4f00-867a-97fe064dffea triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:51.979789 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-4b3be52b-c9ee-4a5f-a7ab-0a297cd92729 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:51.981474 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a4c2c871-6a89-4252-999b-fca8deda978d req-7e30707c-ee37-4fdf-ae7b-dc425211b85d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2116368 Dec 08 11:33:52.028207 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-204f36ce-e2cc-45d8-898e-2777e16b3eaa req-c5f47c3d-0c96-4896-8a76-55a78856e9d0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3131356 Dec 08 11:33:52.073532 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '613f8c98-e083-4296-b340-59fc1326e708', 'name': 'tempest-TestShelveInstance-881503333-router', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38'}], 'enable_snat': True}, 'gw_port_id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:46Z', 'updated_at': '2021-12-08T11:33:47Z', 'revision_number': 3, 'project_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'gw_port': {'id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:25:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '613f8c98-e083-4296-b340-59fc1326e708', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:47Z', 'updated_at': '2021-12-08T11:33:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:52.201221 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Pushing event updated for resources: {'Port': ['ID=cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:52.235418 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d84f983c-76eb-43b3-b856-b3f5c1959826 None None] The sync data for ids ['613f8c98-e083-4296-b340-59fc1326e708'] in dv-cinder-819778-3-iscsi is: [{'id': '613f8c98-e083-4296-b340-59fc1326e708', 'name': 'tempest-TestShelveInstance-881503333-router', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38'}], 'enable_snat': True}, 'gw_port_id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:46Z', 'updated_at': '2021-12-08T11:33:47Z', 'revision_number': 3, 'project_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'gw_port': {'id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:25:6a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '613f8c98-e083-4296-b340-59fc1326e708', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:47Z', 'updated_at': '2021-12-08T11:33:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:33:52.284722 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Network b60280a9-c9a1-4339-81c7-6d947b10537a is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:33:52.286217 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:52.349827 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-717d9fa7-0cf6-4fd7-a804-c782773c6fc3 None None] Provisioning complete for port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:52.350779 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-717d9fa7-0cf6-4fd7-a804-c782773c6fc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:52.467150 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-717d9fa7-0cf6-4fd7-a804-c782773c6fc3 None None] Port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:33:52.503762 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device cee6fedc-1958-4f00-867a-97fe064dffea up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:52.513958 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-46832dec-da99-4ca1-8edd-c0819860a4e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:52.578073 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Router 613f8c98-e083-4296-b340-59fc1326e708 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:33:52.671036 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port cee6fedc-1958-4f00-867a-97fe064dffea triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:52.671560 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:52.853438 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:33:52.873058 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-7d5f79b7-6074-4b72-97e1-9003977e7afb admin admin] 10.222.0.66 "PUT /v2.0/routers/613f8c98-e083-4296-b340-59fc1326e708/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5205395 Dec 08 11:33:52.953018 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:52.973125 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-f10325a5-a948-46a9-9304-3e16471417b3 None None] Provisioning complete for port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:52.973456 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-f10325a5-a948-46a9-9304-3e16471417b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:53.229263 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72376cca-fa78-43db-b8aa-0ab76dfb5efe req-81e609e1-e5f3-4ccf-a463-5e0dc27e96df tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:53.238083 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72376cca-fa78-43db-b8aa-0ab76dfb5efe req-81e609e1-e5f3-4ccf-a463-5e0dc27e96df tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 946 time: 0.2328675 Dec 08 11:33:53.238901 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:53.240923 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:53.292282 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-150bded8-e787-47ec-b26d-bfc86ce3d4ea req-c9e63a14-d8c6-4227-85aa-3af0be5d54df tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:53.301032 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-150bded8-e787-47ec-b26d-bfc86ce3d4ea req-c9e63a14-d8c6-4227-85aa-3af0be5d54df tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1756480 Dec 08 11:33:53.313934 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-f10325a5-a948-46a9-9304-3e16471417b3 None None] Port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:33:53.377453 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72376cca-fa78-43db-b8aa-0ab76dfb5efe req-cd76dbc8-f96a-46b1-a2a9-373556254a4b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1355326 Dec 08 11:33:53.394091 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52822) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:53.463130 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-150bded8-e787-47ec-b26d-bfc86ce3d4ea req-7a89eb07-8c6d-4d39-b6e7-dd6a06f1e13d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1611929 Dec 08 11:33:53.574127 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-859e381f-88e8-4f62-a1bc-0a35dd7a72c4 req-784858e8-d6a5-48bc-804d-f8d79cd38c76 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:53.599318 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-859e381f-88e8-4f62-a1bc-0a35dd7a72c4 req-784858e8-d6a5-48bc-804d-f8d79cd38c76 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 945 time: 0.1330407 Dec 08 11:33:53.695047 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-859e381f-88e8-4f62-a1bc-0a35dd7a72c4 req-9086a54d-ef9d-496c-bac4-63f5bf23b05d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0943041 Dec 08 11:33:54.010736 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc87d66b-340d-4226-9b3e-091e0b04fd75 tempest-TestMinimumBasicScenario-1724632586 tempest-TestMinimumBasicScenario-1724632586-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:54.020456 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-fc87d66b-340d-4226-9b3e-091e0b04fd75 tempest-TestMinimumBasicScenario-1724632586 tempest-TestMinimumBasicScenario-1724632586-project-admin] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 1094 time: 0.6253028 Dec 08 11:33:54.024288 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 52866) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:54.030863 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Request body: {'floatingip': {'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'port_id': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'fixed_ip_address': '172.20.0.12'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:54.087327 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for floatingip, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:54.352039 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:54.407097 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:54.498122 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52896) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:54.504743 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-c6836b08-ce29-4743-a841-e066879a492a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-201663082', 'description': 'tempest-secgroup-smoke-201663082 description', 'project_id': '23027f58b51142389f64405702a0fcd3'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:54.515250 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:54.522931 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:54.583759 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c6836b08-ce29-4743-a841-e066879a492a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:54.593358 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-44dd63fb-77e8-43a8-bad9-38d84e353bf0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:54.609461 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-44dd63fb-77e8-43a8-bad9-38d84e353bf0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/networks?id=6e4bda07-1ae1-4be4-bf28-e94211f51919 HTTP/1.1" status: 200 len: 813 time: 0.3376491 Dec 08 11:33:54.648507 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-5608dfe9-e96f-49d5-bd64-ff31c35a9b83 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/quotas/34e91fcdeaf64d10965b2770cbeab690 HTTP/1.1" status: 200 len: 375 time: 0.0375314 Dec 08 11:33:54.789836 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-6518a07b-ecf5-4a0d-ace6-3d5f4f5d6329 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:54.873693 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:54.918020 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:54.935107 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.017475 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:55.061249 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c6836b08-ce29-4743-a841-e066879a492a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.067232 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c6836b08-ce29-4743-a841-e066879a492a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.106189 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c6836b08-ce29-4743-a841-e066879a492a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.112065 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-c6836b08-ce29-4743-a841-e066879a492a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.6118495 Dec 08 11:33:55.116236 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52918) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:55.121446 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-84b66749-313f-47d6-ac40-32555b8e1eb2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Request body: {'security_group_rule': {'security_group_id': 'e5627452-bf2d-4afd-bd70-91f75757db97', 'project_id': '23027f58b51142389f64405702a0fcd3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:55.128532 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6836b08-ce29-4743-a841-e066879a492a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e5627452-bf2d-4afd-bd70-91f75757db97,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:55.189551 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-84b66749-313f-47d6-ac40-32555b8e1eb2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.199250 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Allocated IP 172.27.2.87 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/c7ff33e6-1ad6-4d1e-933b-b68e4261449c) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:33:55.284080 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-84b66749-313f-47d6-ac40-32555b8e1eb2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.289956 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-84b66749-313f-47d6-ac40-32555b8e1eb2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.302079 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-b15052c4-11b8-430c-806f-150888264829 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&fields=id HTTP/1.1" status: 200 len: 302 time: 0.6526175 Dec 08 11:33:55.329818 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Sync routers for ids ['613f8c98-e083-4296-b340-59fc1326e708'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:33:55.332262 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84b66749-313f-47d6-ac40-32555b8e1eb2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c3403f6c-50ae-4ad6-8315-cc6d3fe76ac0,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:55.344478 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-84b66749-313f-47d6-ac40-32555b8e1eb2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.346908 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-84b66749-313f-47d6-ac40-32555b8e1eb2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2294307 Dec 08 11:33:55.352904 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Routers {'613f8c98-e083-4296-b340-59fc1326e708'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:33:55.352904 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:33:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['613f8c98-e083-4296-b340-59fc1326e708'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:55.354504 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52924) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:55.360738 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-4bccb49d-554c-4446-a088-72b6e8a7cde9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Request body: {'security_group_rule': {'security_group_id': 'e5627452-bf2d-4afd-bd70-91f75757db97', 'project_id': '23027f58b51142389f64405702a0fcd3', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:55.363549 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d711da9-071e-4cbf-b07c-267e36f74096 req-a9c6df78-d108-44d4-91ff-3ae6336ed9e1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:55.369413 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0d711da9-071e-4cbf-b07c-267e36f74096 req-a9c6df78-d108-44d4-91ff-3ae6336ed9e1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.7321243 Dec 08 11:33:55.404411 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4bccb49d-554c-4446-a088-72b6e8a7cde9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.537564 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.539147 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Set router 613f8c98-e083-4296-b340-59fc1326e708 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:33:55.539712 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4bccb49d-554c-4446-a088-72b6e8a7cde9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.562426 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4bccb49d-554c-4446-a088-72b6e8a7cde9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.584897 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0d711da9-071e-4cbf-b07c-267e36f74096 req-4951b4f6-e949-42ab-b9f7-8994da2b4bb5 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1913624 Dec 08 11:33:55.594270 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bccb49d-554c-4446-a088-72b6e8a7cde9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5f558b8a-9553-498b-9453-5c5e3b53ff35,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:55.639078 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4bccb49d-554c-4446-a088-72b6e8a7cde9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.645194 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-4bccb49d-554c-4446-a088-72b6e8a7cde9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2883649 Dec 08 11:33:55.648696 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 52928) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:55.657617 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-204c567d-f7bb-4d98-baa2-cc42080b4a72 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Request body: {'security_group_rule': {'security_group_id': 'e5627452-bf2d-4afd-bd70-91f75757db97', 'project_id': '23027f58b51142389f64405702a0fcd3', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:55.670889 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-25431546-0f6c-479f-a4e7-17ac52831805 service neutron] 10.222.0.66 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3553290 Dec 08 11:33:55.806676 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.827973 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-68d3f2d1-a3dc-42f1-93e9-0fd7789a4759 service neutron] 10.222.0.66 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1462731 Dec 08 11:33:55.837506 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.889564 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event updated for resources: {'Port': ['ID=c7ff33e6-1ad6-4d1e-933b-b68e4261449c,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:55.914656 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-204c567d-f7bb-4d98-baa2-cc42080b4a72 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:55.932432 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '613f8c98-e083-4296-b340-59fc1326e708', 'name': 'tempest-TestShelveInstance-881503333-router', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38'}], 'enable_snat': True}, 'gw_port_id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:46Z', 'updated_at': '2021-12-08T11:33:51Z', 'revision_number': 4, 'project_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'gw_port': {'id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:25:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '613f8c98-e083-4296-b340-59fc1326e708', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:47Z', 'updated_at': '2021-12-08T11:33:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': 'cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca', 'name': '', 'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'mac_address': 'fa:16:3e:69:ae:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '613f8c98-e083-4296-b340-59fc1326e708', 'device_owner': 'network:router_interface', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': 'da2c65e5-a2e3-49fe-9217-53524b9f6c77', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:50Z', 'updated_at': '2021-12-08T11:33:51Z', 'revision_number': 2, 'project_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'subnets': [{'id': 'da2c65e5-a2e3-49fe-9217-53524b9f6c77', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:55.935194 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:33:55.938649 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:33:55.942332 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:33:55.982069 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Checking router: 613f8c98-e083-4296-b340-59fc1326e708 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:33:55.982571 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Updating router 613f8c98-e083-4296-b340-59fc1326e708 port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca binding host dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:33:56.030003 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.170627 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-44d20e73-0ad0-4dcb-930d-5b6279ba8938 req-bcd717e3-6427-4a22-bf6d-e9588bc6fc1a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 210 time: 0.0778487 Dec 08 11:33:56.207292 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-204c567d-f7bb-4d98-baa2-cc42080b4a72 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.231743 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-204c567d-f7bb-4d98-baa2-cc42080b4a72 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.270159 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-204c567d-f7bb-4d98-baa2-cc42080b4a72 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=46b836e0-544f-46f5-abe2-dbd5ffbf1a17,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:56.369544 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-204c567d-f7bb-4d98-baa2-cc42080b4a72 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.370694 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-204c567d-f7bb-4d98-baa2-cc42080b4a72 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.7178710 Dec 08 11:33:56.373439 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52938) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:56.379274 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-4e279b69-c00c-44d6-878f-55a061f25446 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Request body: {'security_group_rule': {'security_group_id': 'e5627452-bf2d-4afd-bd70-91f75757db97', 'project_id': '23027f58b51142389f64405702a0fcd3', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:56.424701 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:56.443487 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4e279b69-c00c-44d6-878f-55a061f25446 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.515596 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:56.516059 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.546613 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4e279b69-c00c-44d6-878f-55a061f25446 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.553304 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4e279b69-c00c-44d6-878f-55a061f25446 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.576976 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e279b69-c00c-44d6-878f-55a061f25446 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1d8d6f0a-568a-437f-af23-c3cf540a301e,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:56.612200 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4e279b69-c00c-44d6-878f-55a061f25446 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.614965 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-4e279b69-c00c-44d6-878f-55a061f25446 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2403476 Dec 08 11:33:56.617589 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52944) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:56.628125 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-832920ff-7e07-42c5-b2b4-05b4fa2e5cd7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Request body: {'security_group_rule': {'security_group_id': 'e5627452-bf2d-4afd-bd70-91f75757db97', 'project_id': '23027f58b51142389f64405702a0fcd3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:56.686803 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.securitygroups_db [None req-832920ff-7e07-42c5-b2b4-05b4fa2e5cd7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Project 23027f58b51142389f64405702a0fcd3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 08 11:33:56.705536 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-832920ff-7e07-42c5-b2b4-05b4fa2e5cd7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.745892 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Publish callbacks [] for port, precommit_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.759445 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.817076 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42ceae80-35fb-4190-8491-71bd1771552d None None] Pushing event updated for resources: {'Port': ['ID=cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:56.883480 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-832920ff-7e07-42c5-b2b4-05b4fa2e5cd7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.891391 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-832920ff-7e07-42c5-b2b4-05b4fa2e5cd7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.895086 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Attempting to bind port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:33:56.895669 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Attempting to bind port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '92b354b3-d3c3-4161-9c7f-a3df7bfcf34b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 286, 'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:33:56.896213 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Attempting to bind port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca on network b60280a9-c9a1-4339-81c7-6d947b10537a {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:33:56.902309 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 33, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:33:56.902968 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Checking segment: {'id': '92b354b3-d3c3-4161-9c7f-a3df7bfcf34b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 286, 'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:33:56.903534 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.904102 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Bound using segment: {'id': '92b354b3-d3c3-4161-9c7f-a3df7bfcf34b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 286, 'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:33:56.904750 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Bound port: cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '92b354b3-d3c3-4161-9c7f-a3df7bfcf34b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 286, 'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:33:56.905509 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.946326 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-832920ff-7e07-42c5-b2b4-05b4fa2e5cd7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b97db64d-9200-4285-a0c9-301475658d7e,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:56.958079 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-832920ff-7e07-42c5-b2b4-05b4fa2e5cd7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:56.959439 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-832920ff-7e07-42c5-b2b4-05b4fa2e5cd7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3406451 Dec 08 11:33:56.964002 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 52952) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:56.973181 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-7fbfad20-902d-4d36-941e-28e57f5b7756 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Request body: {'security_group_rule': {'security_group_id': 'e5627452-bf2d-4afd-bd70-91f75757db97', 'project_id': '23027f58b51142389f64405702a0fcd3', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:57.026951 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.securitygroups_db [None req-7fbfad20-902d-4d36-941e-28e57f5b7756 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Project 23027f58b51142389f64405702a0fcd3 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 08 11:33:57.070491 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] For port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:33:57.074584 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24889409-5f4b-4e0f-883e-47ce7b9355bc req-e6a2750b-e4b0-410a-b2af-6871d2c08b8a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:57.074990 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] For port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca,segment=NetworkSegment(92b354b3-d3c3-4161-9c7f-a3df7bfcf34b),segment_id=92b354b3-d3c3-4161-9c7f-a3df7bfcf34b)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:33:57.087876 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-24889409-5f4b-4e0f-883e-47ce7b9355bc req-e6a2750b-e4b0-410a-b2af-6871d2c08b8a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.3372962 Dec 08 11:33:57.099487 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:57.100575 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:57.103702 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7fbfad20-902d-4d36-941e-28e57f5b7756 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:57.274218 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-24889409-5f4b-4e0f-883e-47ce7b9355bc req-63bbab50-a19f-46c5-8ff8-95cc9ed455b9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1346741 Dec 08 11:33:57.324092 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:57.334454 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Routers {'613f8c98-e083-4296-b340-59fc1326e708'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:33:57.335087 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:33:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['613f8c98-e083-4296-b340-59fc1326e708'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:57.355508 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7fbfad20-902d-4d36-941e-28e57f5b7756 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:57.422178 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cc3c752e-affe-4f4e-885b-40614347b659 req-9fbc4044-b61a-4c79-b43f-1a1fae8d0b50 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 210 time: 0.0613039 Dec 08 11:33:57.443117 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7fbfad20-902d-4d36-941e-28e57f5b7756 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:57.466594 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fbfad20-902d-4d36-941e-28e57f5b7756 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1dc6e3eb-5dc4-4485-8fb6-ca53c87b84cd,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:57.478507 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:57.514322 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42ceae80-35fb-4190-8491-71bd1771552d None None] Pushing event updated for resources: {'Port': ['ID=cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:57.517049 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7fbfad20-902d-4d36-941e-28e57f5b7756 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:57.527882 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-7fbfad20-902d-4d36-941e-28e57f5b7756 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.5531645 Dec 08 11:33:57.528062 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-67b5a914-af74-4df3-90cf-d72d6330c61b None None] Provisioning complete for port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:57.528062 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-67b5a914-af74-4df3-90cf-d72d6330c61b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:57.568699 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] Set router 613f8c98-e083-4296-b340-59fc1326e708 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:33:57.810124 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:57.810124 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:57.854915 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-67b5a914-af74-4df3-90cf-d72d6330c61b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:57.892519 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event updated for resources: {'Port': ['ID=c7ff33e6-1ad6-4d1e-933b-b68e4261449c,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:57.901400 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '613f8c98-e083-4296-b340-59fc1326e708', 'name': 'tempest-TestShelveInstance-881503333-router', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38'}], 'enable_snat': True}, 'gw_port_id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:46Z', 'updated_at': '2021-12-08T11:33:51Z', 'revision_number': 4, 'project_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'gw_port': {'id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:25:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '613f8c98-e083-4296-b340-59fc1326e708', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:47Z', 'updated_at': '2021-12-08T11:33:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': 'cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca', 'name': '', 'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'mac_address': 'fa:16:3e:69:ae:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '613f8c98-e083-4296-b340-59fc1326e708', 'device_owner': 'network:router_interface', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': 'da2c65e5-a2e3-49fe-9217-53524b9f6c77', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:50Z', 'updated_at': '2021-12-08T11:33:57Z', 'revision_number': 4, 'project_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'subnets': [{'id': 'da2c65e5-a2e3-49fe-9217-53524b9f6c77', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:57.942421 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9700906-fdb6-4a43-9b90-d561e739e845 None None] The sync data for ids ['613f8c98-e083-4296-b340-59fc1326e708'] in dv-cinder-819778-3-iscsi is: [{'id': '613f8c98-e083-4296-b340-59fc1326e708', 'name': 'tempest-TestShelveInstance-881503333-router', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38'}], 'enable_snat': True}, 'gw_port_id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:46Z', 'updated_at': '2021-12-08T11:33:51Z', 'revision_number': 4, 'project_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'gw_port': {'id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:25:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '613f8c98-e083-4296-b340-59fc1326e708', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:47Z', 'updated_at': '2021-12-08T11:33:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': 'cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca', 'name': '', 'network_id': 'b60280a9-c9a1-4339-81c7-6d947b10537a', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'mac_address': 'fa:16:3e:69:ae:1c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '613f8c98-e083-4296-b340-59fc1326e708', 'device_owner': 'network:router_interface', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': 'da2c65e5-a2e3-49fe-9217-53524b9f6c77', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:50Z', 'updated_at': '2021-12-08T11:33:57Z', 'revision_number': 4, 'project_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'subnets': [{'id': 'da2c65e5-a2e3-49fe-9217-53524b9f6c77', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:33:57.954949 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-67b5a914-af74-4df3-90cf-d72d6330c61b None None] For port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca,segment=NetworkSegment(92b354b3-d3c3-4161-9c7f-a3df7bfcf34b),segment_id=92b354b3-d3c3-4161-9c7f-a3df7bfcf34b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:33:57.964535 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-67b5a914-af74-4df3-90cf-d72d6330c61b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:57.973043 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:58.106968 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67b5a914-af74-4df3-90cf-d72d6330c61b None None] Pushing event updated for resources: {'Port': ['ID=cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:58.118553 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-f8faeb1c-b215-41f9-b555-fa8304edbcf0 None None] Provisioning complete for port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:58.119112 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-f8faeb1c-b215-41f9-b555-fa8304edbcf0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:58.207137 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:58.429524 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:33:58.531772 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:33:58.532871 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:58.589963 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d751748-2ac6-486d-b923-73a26e273022 req-02f800ae-37b2-4652-9e29-1e44d8320458 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:58.591542 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2d751748-2ac6-486d-b923-73a26e273022 req-02f800ae-37b2-4652-9e29-1e44d8320458 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1823487 Dec 08 11:33:58.598160 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-11fff030-9466-44af-a6c7-d004e5936694 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:58.607015 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-11fff030-9466-44af-a6c7-d004e5936694 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "GET /v2.0/networks?id=6e4bda07-1ae1-4be4-bf28-e94211f51919 HTTP/1.1" status: 200 len: 813 time: 0.5462954 Dec 08 11:33:58.626749 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Floating IP df61cd37-6d91-4fdf-bee1-dfc7294f2b53 associated. External IP: 172.27.2.87, port: 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec. Dec 08 11:33:58.696097 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-319c2a84-71dc-44c4-9d13-855e000369f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Request body: {'port': {'device_id': '01a3f1c2-c5b6-4500-89f8-03ff7a2c4321', 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919', 'admin_state_up': True, 'tenant_id': '34e91fcdeaf64d10965b2770cbeab690'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:58.714450 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e88c83aa-b879-4530-802a-0778e0a58cb0 req-3d9bb19e-5c9b-4a86-af25-a0a359facf63 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 210 time: 0.1053834 Dec 08 11:33:58.962313 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2d751748-2ac6-486d-b923-73a26e273022 req-7214a107-8d26-439c-886f-2b59cbe1219c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3430798 Dec 08 11:33:59.025021 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-319c2a84-71dc-44c4-9d13-855e000369f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Made reservation on behalf of 34e91fcdeaf64d10965b2770cbeab690 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:33:59.028641 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-319c2a84-71dc-44c4-9d13-855e000369f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:59.196655 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:33:59.386968 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-319c2a84-71dc-44c4-9d13-855e000369f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Allocated IP 172.20.0.4 (6e4bda07-1ae1-4be4-bf28-e94211f51919/d6b1fb0e-d38f-47ca-a647-53b824c47e76/be511646-f492-43f2-af08-bc641afcd8a2) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:33:59.442122 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:33:59.454002 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd6effa9-1874-457e-a6f0-24220ff8c683 None None] Sync routers for ids ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:33:59.465904 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd6effa9-1874-457e-a6f0-24220ff8c683 None None] Routers {'c3589b0b-43e0-46da-93f9-ec8e7a1164a6'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:33:59.467066 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-cd6effa9-1874-457e-a6f0-24220ff8c683 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:33:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:33:59.483092 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:59.568887 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-b5138b64-8b1f-4d29-a92f-2edbece95cfd tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 5.5407853 Dec 08 11:33:59.569398 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 52982) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:59.570827 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:33:59.573415 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e5700e3e-bce9-44c6-80f6-d08a762f9050" -d '{"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:33:59.575730 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-0e2b5cb7-b97d-42b7-a615-1b8a21ca85ac tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-2138933485', 'description': 'tempest-secgroup-smoke-2138933485 description', 'project_id': '3102b9c0f7ea45048750ae3c81085631'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:59.620912 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e2b5cb7-b97d-42b7-a615-1b8a21ca85ac tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:59.629627 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-cd6effa9-1874-457e-a6f0-24220ff8c683 None None] Set router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:33:59.669999 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:33:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd1971ed-a373-4bbf-b5fd-b6376c8cd0e5 x-openstack-request-id: req-bd1971ed-a373-4bbf-b5fd-b6376c8cd0e5 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:33:59.669999 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:33:59.671547 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-bd1971ed-a373-4bbf-b5fd-b6376c8cd0e5 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:33:59.671876 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec', 'status': 'completed', 'code': 200} Dec 08 11:33:59.697057 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-319c2a84-71dc-44c4-9d13-855e000369f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:59.758824 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e2b5cb7-b97d-42b7-a615-1b8a21ca85ac tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:59.777870 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e2b5cb7-b97d-42b7-a615-1b8a21ca85ac tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:59.829137 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e2b5cb7-b97d-42b7-a615-1b8a21ca85ac tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:59.847599 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-0e2b5cb7-b97d-42b7-a615-1b8a21ca85ac tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2769518 Dec 08 11:33:59.851504 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 52988) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:33:59.862845 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-5b0b7954-c4fa-4dcb-9ab3-1df8d2fde4ca tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Request body: {'security_group_rule': {'security_group_id': '7c872497-d719-4618-a000-bf3059a98a01', 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:33:59.872673 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e2b5cb7-b97d-42b7-a615-1b8a21ca85ac tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7c872497-d719-4618-a000-bf3059a98a01,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:33:59.889764 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-319c2a84-71dc-44c4-9d13-855e000369f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:33:59.892584 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-32d120cc-30cf-4bb3-b4e1-ec4b202c60bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:33:59.894410 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-32d120cc-30cf-4bb3-b4e1-ec4b202c60bd service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=3102b9c0f7ea45048750ae3c81085631&device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 1099 time: 0.1824634 Dec 08 11:33:59.902817 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['d9ecab87-157e-4ccb-8423-2248bb8451ea', '1d5f08a0-9b25-48d8-a2ed-88647aec1670'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:34:00.053105 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-cd6effa9-1874-457e-a6f0-24220ff8c683 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86'}], 'enable_snat': True}, 'gw_port_id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:14Z', 'revision_number': 4, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port': {'id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:50:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 278, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'df61cd37-6d91-4fdf-bee1-dfc7294f2b53', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'floating_ip_address': '172.27.2.87', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'port_id': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 373, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'mac_address': 'fa:16:3e:cd:c1:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:33:56Z', 'updated_at': '2021-12-08T11:33:56Z', 'revision_number': 0, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '00496e9d-a438-4edc-b803-98d3f6b8e626', 'name': '', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'mac_address': 'fa:16:3e:37:98:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 279, 'fixed_ips': [{'subnet_id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:14Z', 'updated_at': '2021-12-08T11:32:19Z', 'revision_number': 5, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'subnets': [{'id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:34:00.098369 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd6effa9-1874-457e-a6f0-24220ff8c683 None None] Checking router: c3589b0b-43e0-46da-93f9-ec8e7a1164a6 for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:34:00.108782 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd6effa9-1874-457e-a6f0-24220ff8c683 None None] Routers {'c3589b0b-43e0-46da-93f9-ec8e7a1164a6'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:34:00.109684 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-cd6effa9-1874-457e-a6f0-24220ff8c683 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:33:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:34:00.294818 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-cd6effa9-1874-457e-a6f0-24220ff8c683 None None] Set router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:34:00.386360 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-319c2a84-71dc-44c4-9d13-855e000369f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Network 6e4bda07-1ae1-4be4-bf28-e94211f51919 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:34:00.416175 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-319c2a84-71dc-44c4-9d13-855e000369f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:34:00.424374 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-319c2a84-71dc-44c4-9d13-855e000369f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:34:00.479776 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-5b0b7954-c4fa-4dcb-9ab3-1df8d2fde4ca tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:00.486570 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-319c2a84-71dc-44c4-9d13-855e000369f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Pushing event updated for resources: {'Port': ['ID=be511646-f492-43f2-af08-bc641afcd8a2,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:00.570184 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d966ced2-aa3a-49ce-8b6f-d28ab8d9a48b req-b971922c-4d95-4285-807a-2a22f7eb177f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:00.577730 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d966ced2-aa3a-49ce-8b6f-d28ab8d9a48b req-b971922c-4d95-4285-807a-2a22f7eb177f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 931 time: 0.6944189 Dec 08 11:34:00.584937 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-319c2a84-71dc-44c4-9d13-855e000369f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:00.585619 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-319c2a84-71dc-44c4-9d13-855e000369f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:00.646105 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-ab553510-3f43-41ba-87b5-fc88bb0f6d6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:00.647624 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-ab553510-3f43-41ba-87b5-fc88bb0f6d6a service neutron] 10.222.0.61 "GET /v2.0/networks?id=f5a54297-6b64-4f71-b9f2-2f9c14a03187 HTTP/1.1" status: 200 len: 915 time: 0.7082446 Dec 08 11:34:00.662912 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-cd6effa9-1874-457e-a6f0-24220ff8c683 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86'}], 'enable_snat': True}, 'gw_port_id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:14Z', 'revision_number': 4, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port': {'id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:50:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 278, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'df61cd37-6d91-4fdf-bee1-dfc7294f2b53', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'floating_ip_address': '172.27.2.87', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'port_id': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 373, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'mac_address': 'fa:16:3e:cd:c1:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:33:56Z', 'updated_at': '2021-12-08T11:33:56Z', 'revision_number': 0, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '00496e9d-a438-4edc-b803-98d3f6b8e626', 'name': '', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'mac_address': 'fa:16:3e:37:98:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 279, 'fixed_ips': [{'subnet_id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:14Z', 'updated_at': '2021-12-08T11:32:19Z', 'revision_number': 5, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'subnets': [{'id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:34:00.666186 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-319c2a84-71dc-44c4-9d13-855e000369f4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.9744320 Dec 08 11:34:00.692403 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0193942-e88b-4fe8-adf9-08351327569c req-b53b12be-34f5-45db-a240-42532ca4516d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:00.699912 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f0193942-e88b-4fe8-adf9-08351327569c req-b53b12be-34f5-45db-a240-42532ca4516d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.3158901 Dec 08 11:34:00.704515 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd6effa9-1874-457e-a6f0-24220ff8c683 None None] The sync data for ids ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'] in dv-cinder-819778-3-iscsi is: [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86'}], 'enable_snat': True}, 'gw_port_id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:14Z', 'revision_number': 4, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port': {'id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:50:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 278, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'df61cd37-6d91-4fdf-bee1-dfc7294f2b53', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'floating_ip_address': '172.27.2.87', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'port_id': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 373, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'mac_address': 'fa:16:3e:cd:c1:66', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:33:56Z', 'updated_at': '2021-12-08T11:33:56Z', 'revision_number': 0, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '00496e9d-a438-4edc-b803-98d3f6b8e626', 'name': '', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'mac_address': 'fa:16:3e:37:98:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 279, 'fixed_ips': [{'subnet_id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:14Z', 'updated_at': '2021-12-08T11:32:19Z', 'revision_number': 5, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'subnets': [{'id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:34:00.742587 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Request body: {'port': {'device_id': '01a3f1c2-c5b6-4500-89f8-03ff7a2c4321', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:34:00.819013 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-5b0b7954-c4fa-4dcb-9ab3-1df8d2fde4ca tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:00.832708 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d966ced2-aa3a-49ce-8b6f-d28ab8d9a48b req-7659b0eb-7bb8-4179-a6aa-e60486009d61 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2539420 Dec 08 11:34:00.864666 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-5b0b7954-c4fa-4dcb-9ab3-1df8d2fde4ca tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:00.901607 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-4a7ee0ea-28bf-45e0-8102-feeaf6b502cd service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec HTTP/1.1" status: 200 len: 999 time: 0.2392137 Dec 08 11:34:00.939319 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f0193942-e88b-4fe8-adf9-08351327569c req-360c2bf4-78a0-43e9-92e4-3f5ecf516a0f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2382207 Dec 08 11:34:00.950846 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b0b7954-c4fa-4dcb-9ab3-1df8d2fde4ca tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dca81be4-f729-4ec2-9ee6-5e516d856f49,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:00.980129 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-5b0b7954-c4fa-4dcb-9ab3-1df8d2fde4ca tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:00.981444 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-5b0b7954-c4fa-4dcb-9ab3-1df8d2fde4ca tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.1292839 Dec 08 11:34:00.984255 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:00.984545 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 53002) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:34:00.990088 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-72d81b65-5626-4375-9de7-e5d35e81b859 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Request body: {'security_group_rule': {'security_group_id': '7c872497-d719-4618-a000-bf3059a98a01', 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:34:01.034382 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-72d81b65-5626-4375-9de7-e5d35e81b859 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.051311 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d37b8e92-5100-467c-bf44-3c0a8efb1706 None None] New status for floating IP df61cd37-6d91-4fdf-bee1-dfc7294f2b53: ACTIVE {{(pid=102319) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:34:01.097664 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-72d81b65-5626-4375-9de7-e5d35e81b859 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.107728 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-72d81b65-5626-4375-9de7-e5d35e81b859 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.131033 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72d81b65-5626-4375-9de7-e5d35e81b859 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=051638c1-5bcd-4420-90d5-b8b1a1a11d77,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:01.150432 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-72d81b65-5626-4375-9de7-e5d35e81b859 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.152330 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-72d81b65-5626-4375-9de7-e5d35e81b859 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1660032 Dec 08 11:34:01.161715 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 53006) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:34:01.169780 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-05da8a34-ad22-453a-9d8b-3905159ae98d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Request body: {'security_group_rule': {'security_group_id': '7c872497-d719-4618-a000-bf3059a98a01', 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:34:01.247032 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-05da8a34-ad22-453a-9d8b-3905159ae98d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.328908 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-f1feebf3-0049-4d16-87b0-4550e328cc81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:01.345203 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-f1feebf3-0049-4d16-87b0-4550e328cc81 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=07f39602-a4ed-4df9-a6e2-9c0943b66135 HTTP/1.1" status: 200 len: 853 time: 0.4143693 Dec 08 11:34:01.384785 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-05da8a34-ad22-453a-9d8b-3905159ae98d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.392328 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-05da8a34-ad22-453a-9d8b-3905159ae98d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.424235 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05da8a34-ad22-453a-9d8b-3905159ae98d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ce8e3728-c7f9-469d-b97d-91ea3185517f,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:01.450685 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-05da8a34-ad22-453a-9d8b-3905159ae98d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.452362 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-05da8a34-ad22-453a-9d8b-3905159ae98d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2888064 Dec 08 11:34:01.455194 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 53008) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:34:01.459904 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-6d27e14a-43d8-44cb-8cda-7bb7aacd63b3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Request body: {'security_group_rule': {'security_group_id': '7c872497-d719-4618-a000-bf3059a98a01', 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:34:01.479232 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id be511646-f492-43f2-af08-bc641afcd8a2 {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:34:01.495840 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-2174df41-4f87-4507-9399-1af539cdd3b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:01.496637 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6d27e14a-43d8-44cb-8cda-7bb7aacd63b3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.497472 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-2174df41-4f87-4507-9399-1af539cdd3b2 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=f5a54297-6b64-4f71-b9f2-2f9c14a03187&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1375406 Dec 08 11:34:01.508632 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.538114 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Transition to ACTIVE for port object be511646-f492-43f2-af08-bc641afcd8a2 will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:34:01.578134 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6d27e14a-43d8-44cb-8cda-7bb7aacd63b3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.584434 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6d27e14a-43d8-44cb-8cda-7bb7aacd63b3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.588092 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.599195 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d27e14a-43d8-44cb-8cda-7bb7aacd63b3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=553e8320-399c-4e75-8eb4-cb2f42dd6f22,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:01.624798 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6d27e14a-43d8-44cb-8cda-7bb7aacd63b3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.626502 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-6d27e14a-43d8-44cb-8cda-7bb7aacd63b3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1702530 Dec 08 11:34:01.629495 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 53010) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:34:01.634327 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-f48045b6-a9b3-475b-941d-fa4749d8a139 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Request body: {'security_group_rule': {'security_group_id': '7c872497-d719-4618-a000-bf3059a98a01', 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:34:01.675336 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Pushing event updated for resources: {'Port': ['ID=be511646-f492-43f2-af08-bc641afcd8a2,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:01.680734 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.securitygroups_db [None req-f48045b6-a9b3-475b-941d-fa4749d8a139 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Project 3102b9c0f7ea45048750ae3c81085631 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 08 11:34:01.687234 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f48045b6-a9b3-475b-941d-fa4749d8a139 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.751583 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f48045b6-a9b3-475b-941d-fa4749d8a139 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.756650 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f48045b6-a9b3-475b-941d-fa4749d8a139 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.760920 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-d5e3ceb8-b2cb-4f74-a67d-faaa5386af64 service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2397733 Dec 08 11:34:01.782683 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f48045b6-a9b3-475b-941d-fa4749d8a139 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ba2ac25a-4895-4659-921d-aed87d6b2704,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:01.789077 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f48045b6-a9b3-475b-941d-fa4749d8a139 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.793234 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-f48045b6-a9b3-475b-941d-fa4749d8a139 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1596682 Dec 08 11:34:01.794340 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 53012) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:34:01.800027 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-8b23e670-dcbb-49d4-82ce-75eaaa6fe4fc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Request body: {'security_group_rule': {'security_group_id': '7c872497-d719-4618-a000-bf3059a98a01', 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:34:01.836422 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.securitygroups_db [None req-8b23e670-dcbb-49d4-82ce-75eaaa6fe4fc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Project 3102b9c0f7ea45048750ae3c81085631 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 08 11:34:01.843208 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Attempting to bind port be511646-f492-43f2-af08-bc641afcd8a2 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:34:01.843572 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Attempting to bind port be511646-f492-43f2-af08-bc641afcd8a2 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:34:01.843972 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Attempting to bind port be511646-f492-43f2-af08-bc641afcd8a2 on network 6e4bda07-1ae1-4be4-bf28-e94211f51919 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:34:01.846438 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8b23e670-dcbb-49d4-82ce-75eaaa6fe4fc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.849999 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Port be511646-f492-43f2-af08-bc641afcd8a2 on network 6e4bda07-1ae1-4be4-bf28-e94211f51919 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:34:01.850354 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Attempting to bind port be511646-f492-43f2-af08-bc641afcd8a2 on network 6e4bda07-1ae1-4be4-bf28-e94211f51919 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:34:01.858480 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 33, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:34:01.858826 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Checking segment: {'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:34:01.859238 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Bound using segment: {'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:34:01.859691 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Bound port: be511646-f492-43f2-af08-bc641afcd8a2, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:34:01.860012 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.941613 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] For port be511646-f492-43f2-af08-bc641afcd8a2, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:34:01.944775 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] For port be511646-f492-43f2-af08-bc641afcd8a2, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=be511646-f492-43f2-af08-bc641afcd8a2,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:34:01.963792 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.990894 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8b23e670-dcbb-49d4-82ce-75eaaa6fe4fc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:01.997789 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8b23e670-dcbb-49d4-82ce-75eaaa6fe4fc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:02.022628 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5700e3e-bce9-44c6-80f6-d08a762f9050 req-2450fc4f-452e-471d-abcc-de06654f5492 service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2507360 Dec 08 11:34:02.033609 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b23e670-dcbb-49d4-82ce-75eaaa6fe4fc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b45b0064-8714-4744-ba71-75631fb6cfe5,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:02.037821 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:02.038586 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:02.040477 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] 10.222.0.61 "PUT /v2.0/ports/be511646-f492-43f2-af08-bc641afcd8a2 HTTP/1.1" status: 200 len: 1093 time: 1.3574159 Dec 08 11:34:02.044907 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '01a3f1c2-c5b6-4500-89f8-03ff7a2c4321', 'tag': 'be511646-f492-43f2-af08-bc641afcd8a2'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:34:02.049458 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-85376125-5e82-4c1a-a60f-d9655edc80e5" -d '{"events": [{"name": "network-changed", "server_uuid": "01a3f1c2-c5b6-4500-89f8-03ff7a2c4321", "tag": "be511646-f492-43f2-af08-bc641afcd8a2"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:34:02.066912 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8b23e670-dcbb-49d4-82ce-75eaaa6fe4fc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:02.071540 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-8b23e670-dcbb-49d4-82ce-75eaaa6fe4fc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2750916 Dec 08 11:34:02.127982 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4546a578-0799-4a9d-91fa-aa285c04aec8 service neutron] Pushing event updated for resources: {'Port': ['ID=be511646-f492-43f2-af08-bc641afcd8a2,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:02.138965 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a161d5b-4ba0-4f6d-9bdd-d9fdf6a423ad req-cf0792c3-925c-44ac-bc1e-3148170ee769 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:02.140480 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0a161d5b-4ba0-4f6d-9bdd-d9fdf6a423ad req-cf0792c3-925c-44ac-bc1e-3148170ee769 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.1924124 Dec 08 11:34:02.222325 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-be7ac42c-beb4-4234-bf90-32ebebfb5e73 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:02.224716 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-be7ac42c-beb4-4234-bf90-32ebebfb5e73 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 1096 time: 0.1091597 Dec 08 11:34:02.233657 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bafa7d0b-39d8-44c7-a630-63585b144b4d req-cb7721db-d13d-4415-b14c-ff8f8e8178fe tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:02.235220 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bafa7d0b-39d8-44c7-a630-63585b144b4d req-cb7721db-d13d-4415-b14c-ff8f8e8178fe tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1612997 Dec 08 11:34:02.291332 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0a161d5b-4ba0-4f6d-9bdd-d9fdf6a423ad req-6bcc6891-aa9a-414e-88d7-260888c647a9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1286302 Dec 08 11:34:02.292522 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-5812cb47-b77a-481a-834f-672edf14a41b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=be511646-f492-43f2-af08-bc641afcd8a2 HTTP/1.1" status: 200 len: 217 time: 0.0522544 Dec 08 11:34:02.357759 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bafa7d0b-39d8-44c7-a630-63585b144b4d req-01f8b313-b7bd-4e33-a3a3-a08f7cbe44d5 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1117408 Dec 08 11:34:02.384205 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-3bed65ec-c356-4bcf-aff5-d62344c242a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:02.384205 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-3bed65ec-c356-4bcf-aff5-d62344c242a3 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=d6b1fb0e-d38f-47ca-a647-53b824c47e76 HTTP/1.1" status: 200 len: 853 time: 0.0734572 Dec 08 11:34:02.419954 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-d6fd4fef-bd0e-4d26-91ee-1ecb126e792b service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=6e4bda07-1ae1-4be4-bf28-e94211f51919&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0316243 Dec 08 11:34:02.423218 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:34:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cdf7e173-6bd8-4949-8e62-b342babad916 x-openstack-request-id: req-cdf7e173-6bd8-4949-8e62-b342babad916 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:34:02.423763 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "01a3f1c2-c5b6-4500-89f8-03ff7a2c4321", "tag": "be511646-f492-43f2-af08-bc641afcd8a2", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:34:02.424222 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-cdf7e173-6bd8-4949-8e62-b342babad916 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:34:02.424778 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '01a3f1c2-c5b6-4500-89f8-03ff7a2c4321', 'tag': 'be511646-f492-43f2-af08-bc641afcd8a2', 'status': 'completed', 'code': 200} Dec 08 11:34:02.573536 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-34683753-3e58-4a24-81b3-b43c1c88f293 req-27936ac8-e8c3-4d94-81d7-3f4ca5625c7e tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2138933485&fields=id&tenant_id=3102b9c0f7ea45048750ae3c81085631 HTTP/1.1" status: 200 len: 267 time: 0.0774767 Dec 08 11:34:02.598822 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-174abec8-acbb-4a8a-9461-f1324c831804 service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1553495 Dec 08 11:34:02.686253 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34683753-3e58-4a24-81b3-b43c1c88f293 req-c012e76d-b162-4f36-854d-77e474c1cbbc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:02.688740 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-34683753-3e58-4a24-81b3-b43c1c88f293 req-c012e76d-b162-4f36-854d-77e474c1cbbc tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 946 time: 0.1038065 Dec 08 11:34:02.707275 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-34683753-3e58-4a24-81b3-b43c1c88f293 req-d4ea28f6-5489-4015-8247-8e822ff8bca3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Request body: {'port': {'security_groups': ['18816c08-841a-4a06-aa5d-1bb76e44c9f4', '7c872497-d719-4618-a000-bf3059a98a01']}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:34:02.747778 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc9d2daa-6bb4-4bb2-a2cc-6977e0acaa1e req-3f4f4aad-2f87-4450-85f5-3a1bc7eab6b2 service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1353569 Dec 08 11:34:02.791315 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-34683753-3e58-4a24-81b3-b43c1c88f293 req-d4ea28f6-5489-4015-8247-8e822ff8bca3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:02.887096 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-c30cd5d1-d5aa-4c15-a366-072851056a0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:02.888576 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-c30cd5d1-d5aa-4c15-a366-072851056a0e service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 1096 time: 0.0860674 Dec 08 11:34:03.048967 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-18ecd518-98f8-493a-9a76-602dda97c4c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:03.050345 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-18ecd518-98f8-493a-9a76-602dda97c4c9 service neutron] 10.222.0.61 "GET /v2.0/networks?id=6e4bda07-1ae1-4be4-bf28-e94211f51919 HTTP/1.1" status: 200 len: 914 time: 0.1518648 Dec 08 11:34:03.101212 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-c9aec64f-4678-4a17-a326-0f2ca2184922 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=be511646-f492-43f2-af08-bc641afcd8a2 HTTP/1.1" status: 200 len: 217 time: 0.0390921 Dec 08 11:34:03.120810 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-34683753-3e58-4a24-81b3-b43c1c88f293 req-d4ea28f6-5489-4015-8247-8e822ff8bca3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] For port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:34:03.191003 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-83a7539a-adc8-460a-b421-b697d3f0c9a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:03.192686 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-83a7539a-adc8-460a-b421-b697d3f0c9a8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=d6b1fb0e-d38f-47ca-a647-53b824c47e76 HTTP/1.1" status: 200 len: 853 time: 0.0811934 Dec 08 11:34:03.194777 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-34683753-3e58-4a24-81b3-b43c1c88f293 req-d4ea28f6-5489-4015-8247-8e822ff8bca3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:03.200693 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-34683753-3e58-4a24-81b3-b43c1c88f293 req-d4ea28f6-5489-4015-8247-8e822ff8bca3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:03.226360 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['7fe8b63d-f6cd-45dc-a53c-93b64cacfeec'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:34:03.273858 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34683753-3e58-4a24-81b3-b43c1c88f293 req-d4ea28f6-5489-4015-8247-8e822ff8bca3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:03.274495 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-34683753-3e58-4a24-81b3-b43c1c88f293 req-d4ea28f6-5489-4015-8247-8e822ff8bca3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:03.279094 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-34683753-3e58-4a24-81b3-b43c1c88f293 req-d4ea28f6-5489-4015-8247-8e822ff8bca3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "PUT /v2.0/ports/7fe8b63d-f6cd-45dc-a53c-93b64cacfeec HTTP/1.1" status: 200 len: 982 time: 0.5824919 Dec 08 11:34:03.284347 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-0fed5418-9a37-4702-a3c4-93b1546de7e7 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=6e4bda07-1ae1-4be4-bf28-e94211f51919&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0776253 Dec 08 11:34:03.373710 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4ea28f6-5489-4015-8247-8e822ff8bca3 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event updated for resources: {'Port': ['ID=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,revision_number=6']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:03.434854 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['7fe8b63d-f6cd-45dc-a53c-93b64cacfeec'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:34:03.509375 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-dfddd26c-3176-41c1-86cb-d13d3e9bfb44 service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2010391 Dec 08 11:34:03.652939 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35193380-f519-4e6d-9897-9937515fa9c0 req-5a8dc5ac-0139-4024-816b-21733d181fe2 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:03.655288 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-35193380-f519-4e6d-9897-9937515fa9c0 req-5a8dc5ac-0139-4024-816b-21733d181fe2 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.2848287 Dec 08 11:34:03.666633 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e61e6aab-4187-49ef-a29d-95c99fdb2a1b req-ccb2928a-4d7e-417d-9149-37c9231196a4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:03.668404 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e61e6aab-4187-49ef-a29d-95c99fdb2a1b req-ccb2928a-4d7e-417d-9149-37c9231196a4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.2297242 Dec 08 11:34:03.711123 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85376125-5e82-4c1a-a60f-d9655edc80e5 req-66e04017-c5fe-4111-8c9a-6baf3657e277 service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1782486 Dec 08 11:34:03.731257 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-91a0391b-9c78-4259-9764-74bbf6e406d0 None None] Provisioning complete for port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:34:03.731627 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-91a0391b-9c78-4259-9764-74bbf6e406d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:03.785951 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e61e6aab-4187-49ef-a29d-95c99fdb2a1b req-4712a63e-6e23-4071-938b-4191bc4bff8b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1019547 Dec 08 11:34:03.792038 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-35193380-f519-4e6d-9897-9937515fa9c0 req-2a217537-c71d-47ab-bbba-226d05a0d30d tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1193004 Dec 08 11:34:03.928025 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c39b25f-08eb-40e5-9afd-a5b54f5e7463 req-3a3f75a6-8c0c-40d4-845c-ae6be55553f3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:03.929612 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4c39b25f-08eb-40e5-9afd-a5b54f5e7463 req-3a3f75a6-8c0c-40d4-845c-ae6be55553f3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0536087 Dec 08 11:34:03.997397 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4c39b25f-08eb-40e5-9afd-a5b54f5e7463 req-604f5610-6296-49b0-bf7f-c58f30f1155d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0597885 Dec 08 11:34:04.425829 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:34:04.428765 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c4e3d9f2-50e8-415b-af92-13b766936f5f" -d '{"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:34:04.467219 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:34:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d3e3042b-8b2e-4da5-979f-aebc6fb1e8bb x-openstack-request-id: req-d3e3042b-8b2e-4da5-979f-aebc6fb1e8bb {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:34:04.467518 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:34:04.467777 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-d3e3042b-8b2e-4da5-979f-aebc6fb1e8bb {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:34:04.468267 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec', 'status': 'completed', 'code': 200} Dec 08 11:34:04.559171 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-7557ddb6-3d8f-496b-bb2a-c664f9b33a6b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:04.560658 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-7557ddb6-3d8f-496b-bb2a-c664f9b33a6b service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=3102b9c0f7ea45048750ae3c81085631&device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 1138 time: 0.0413918 Dec 08 11:34:04.677430 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-029a1f4c-92bb-42d3-9295-8f3681d6a4cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:04.679277 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-029a1f4c-92bb-42d3-9295-8f3681d6a4cd service neutron] 10.222.0.61 "GET /v2.0/networks?id=f5a54297-6b64-4f71-b9f2-2f9c14a03187 HTTP/1.1" status: 200 len: 915 time: 0.1026165 Dec 08 11:34:04.748528 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-b1b815e7-0ff5-47d5-a361-fa21fe219ee2 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec HTTP/1.1" status: 200 len: 1001 time: 0.0616672 Dec 08 11:34:04.808008 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-586bc24c-c8b2-448c-9960-e27f59ca65b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:04.809753 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-586bc24c-c8b2-448c-9960-e27f59ca65b4 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=07f39602-a4ed-4df9-a6e2-9c0943b66135 HTTP/1.1" status: 200 len: 853 time: 0.0517821 Dec 08 11:34:05.246894 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-2ab6b905-ff1e-460c-9858-c00147475d23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:05.248635 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-2ab6b905-ff1e-460c-9858-c00147475d23 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=f5a54297-6b64-4f71-b9f2-2f9c14a03187&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.4265378 Dec 08 11:34:05.264695 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-314a3e69-0929-4408-bd80-8cfc3b63c9f9 req-9c621f5e-9b04-4b51-8ae7-d8d23a4e6bdc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:05.266224 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-314a3e69-0929-4408-bd80-8cfc3b63c9f9 req-9c621f5e-9b04-4b51-8ae7-d8d23a4e6bdc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.1086850 Dec 08 11:34:05.276900 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ade0b87-9137-430f-9dfb-5fbd8f54c558 req-9db7b62c-9178-4192-a873-76441c64028a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:05.278537 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8ade0b87-9137-430f-9dfb-5fbd8f54c558 req-9db7b62c-9178-4192-a873-76441c64028a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1078711 Dec 08 11:34:05.436877 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8ade0b87-9137-430f-9dfb-5fbd8f54c558 req-20608ba0-52c1-4caa-bb7a-ec068ac5d52f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1474035 Dec 08 11:34:05.450501 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-314a3e69-0929-4408-bd80-8cfc3b63c9f9 req-0c8b1edd-468b-4918-ad95-ff8b2e500de4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1637702 Dec 08 11:34:05.475341 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-a968a875-8afa-4020-b15f-d5270bb33315 service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2080104 Dec 08 11:34:05.584696 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4e3d9f2-50e8-415b-af92-13b766936f5f req-096a73ef-480d-430a-86e8-a5cd12d077c9 service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0954959 Dec 08 11:34:06.631617 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95564ac-e55b-4fbb-bf6a-20a92dc00b5f req-942045f2-8138-44b7-a281-0bd458d35ba0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:06.634442 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d95564ac-e55b-4fbb-bf6a-20a92dc00b5f req-942045f2-8138-44b7-a281-0bd458d35ba0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1134691 Dec 08 11:34:06.652280 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb560642-6ab1-4c19-bef9-f237bd8065aa req-a3da1706-21b2-4eea-961c-e199c73edaa6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:06.654218 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bb560642-6ab1-4c19-bef9-f237bd8065aa req-a3da1706-21b2-4eea-961c-e199c73edaa6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.0988135 Dec 08 11:34:06.739150 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d95564ac-e55b-4fbb-bf6a-20a92dc00b5f req-9df13534-0ffb-4af9-924f-dfa078d6f993 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0837202 Dec 08 11:34:06.743753 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bb560642-6ab1-4c19-bef9-f237bd8065aa req-3fb6ded2-0bf6-4615-a20e-7b9c28ee41e0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0815504 Dec 08 11:34:07.906887 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198e1f9a-7a27-4b41-89ac-70fe8474f362 req-3e5b7e31-4605-49f5-ad6f-e2b79cc098b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:07.909007 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-198e1f9a-7a27-4b41-89ac-70fe8474f362 req-3e5b7e31-4605-49f5-ad6f-e2b79cc098b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.0702994 Dec 08 11:34:07.917588 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b2fe49-6b7c-4ba9-9141-fba670c23c08 req-213efd6f-604c-4ac3-8c23-549c475f48b4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:07.919005 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-90b2fe49-6b7c-4ba9-9141-fba670c23c08 req-213efd6f-604c-4ac3-8c23-549c475f48b4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0898147 Dec 08 11:34:07.998006 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-198e1f9a-7a27-4b41-89ac-70fe8474f362 req-105827a5-edc0-4ef7-b54f-87dabb7739ad tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780010 Dec 08 11:34:08.001491 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-90b2fe49-6b7c-4ba9-9141-fba670c23c08 req-ac4bc887-2539-4e14-858c-aa2d876250ad tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0756338 Dec 08 11:34:09.157492 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39916e36-420f-4363-840c-b422440bbcaa req-a3935580-4ca5-4a66-b1cf-9cf739727323 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:09.160885 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-39916e36-420f-4363-840c-b422440bbcaa req-a3935580-4ca5-4a66-b1cf-9cf739727323 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0836432 Dec 08 11:34:09.176747 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f1ab011-8c17-49f3-b04e-db19daf0c8fe req-6716f5cc-ddf7-41a4-bd52-70907ca7f78a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:09.178491 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2f1ab011-8c17-49f3-b04e-db19daf0c8fe req-6716f5cc-ddf7-41a4-bd52-70907ca7f78a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.0746624 Dec 08 11:34:09.246928 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-39916e36-420f-4363-840c-b422440bbcaa req-fd13dae8-802c-40cf-9f57-aa0b8b70489b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673549 Dec 08 11:34:09.259778 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2f1ab011-8c17-49f3-b04e-db19daf0c8fe req-9bbede88-4317-4bfa-a376-57a89990a98a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0743418 Dec 08 11:34:10.426533 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e9bdcc0-8b23-4af0-9d6e-7bc09818e615 req-bb4810ab-4748-410b-b730-f38f4a3216fc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:10.428110 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6e9bdcc0-8b23-4af0-9d6e-7bc09818e615 req-bb4810ab-4748-410b-b730-f38f4a3216fc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1006036 Dec 08 11:34:10.437840 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1b1498-d657-4642-ab85-dcf074e844b4 req-1fde73a4-50c1-4121-9509-966b0a18fa85 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:10.439480 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b1b1498-d657-4642-ab85-dcf074e844b4 req-1fde73a4-50c1-4121-9509-966b0a18fa85 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.0910201 Dec 08 11:34:10.522377 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6e9bdcc0-8b23-4af0-9d6e-7bc09818e615 req-6a53f1a7-5cd4-4a06-aa76-c47cd3ab1665 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0817165 Dec 08 11:34:10.530007 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b1b1498-d657-4642-ab85-dcf074e844b4 req-a7df2ce1-825e-4daf-9e2f-dd4319cd7596 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0812216 Dec 08 11:34:10.894267 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:34:11.698739 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a19cafc-5a6d-458d-a761-dd17374737e0 req-7b5bcf77-1d35-4fe1-b417-cf3da6d75641 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:11.700951 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9a19cafc-5a6d-458d-a761-dd17374737e0 req-7b5bcf77-1d35-4fe1-b417-cf3da6d75641 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.0921049 Dec 08 11:34:11.730319 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1784eb4-d368-474c-a5ee-71cdec34fe18 req-49692340-e068-4dc0-ab91-13abb93acbe3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:11.731821 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d1784eb4-d368-474c-a5ee-71cdec34fe18 req-49692340-e068-4dc0-ab91-13abb93acbe3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0941358 Dec 08 11:34:11.805006 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9a19cafc-5a6d-458d-a761-dd17374737e0 req-429c4ad0-c9fb-4670-a7b6-4940d3016a5d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0968289 Dec 08 11:34:11.813640 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d1784eb4-d368-474c-a5ee-71cdec34fe18 req-c0f053d7-9d87-4cb2-80c0-9ede8495f643 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732677 Dec 08 11:34:12.978247 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0372f2b-fb9d-4cf8-b607-856ea53e61e7 req-d398ebf5-6155-4928-b4e3-47b30160657c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:12.979835 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f0372f2b-fb9d-4cf8-b607-856ea53e61e7 req-d398ebf5-6155-4928-b4e3-47b30160657c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0811636 Dec 08 11:34:12.988349 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b825b9e3-39b8-4e1f-b48e-98b61e8b4ea3 req-f306b298-f5bb-4bbd-b237-11c3166aadae tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:12.989781 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b825b9e3-39b8-4e1f-b48e-98b61e8b4ea3 req-f306b298-f5bb-4bbd-b237-11c3166aadae tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.0822415 Dec 08 11:34:13.070571 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f0372f2b-fb9d-4cf8-b607-856ea53e61e7 req-dba719fb-d252-4827-8812-5613e65e2e62 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797460 Dec 08 11:34:13.073697 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b825b9e3-39b8-4e1f-b48e-98b61e8b4ea3 req-d3c3f41c-b1e8-4393-8a4b-95c6082e9b65 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0774109 Dec 08 11:34:14.240419 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24da0871-8d10-4513-bb9d-8b717592f6e6 req-e6932c11-6c5c-4ee0-87e0-dd40b361fb2e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:14.242305 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-24da0871-8d10-4513-bb9d-8b717592f6e6 req-e6932c11-6c5c-4ee0-87e0-dd40b361fb2e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0861642 Dec 08 11:34:14.255472 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c78fbfaf-7b3d-4925-b9bf-e95b7c7cb36d req-31129ce1-beac-458d-a0ec-5105d8669125 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:14.257095 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c78fbfaf-7b3d-4925-b9bf-e95b7c7cb36d req-31129ce1-beac-458d-a0ec-5105d8669125 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.0735679 Dec 08 11:34:14.354085 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-24da0871-8d10-4513-bb9d-8b717592f6e6 req-0549ee44-09ce-4c39-b35e-eb1f7c57988b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0958164 Dec 08 11:34:14.373682 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c78fbfaf-7b3d-4925-b9bf-e95b7c7cb36d req-2014d931-a4bd-4324-a3a8-1685ea984ca7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1074517 Dec 08 11:34:14.704741 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-45f22a49-b6c7-4717-9416-73171b92fb22 req-261d5c51-5ef8-462e-8763-99e418161f9d service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0442445 Dec 08 11:34:14.781518 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f22a49-b6c7-4717-9416-73171b92fb22 req-595970e2-17dd-4425-88e6-988c4005b06b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:14.783655 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-45f22a49-b6c7-4717-9416-73171b92fb22 req-595970e2-17dd-4425-88e6-988c4005b06b service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 1099 time: 0.0495045 Dec 08 11:34:14.903900 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f22a49-b6c7-4717-9416-73171b92fb22 req-0fb5b58c-734c-465e-85fe-cb73b5b56d0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:14.905914 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-45f22a49-b6c7-4717-9416-73171b92fb22 req-0fb5b58c-734c-465e-85fe-cb73b5b56d0e service neutron] 10.222.0.61 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 917 time: 0.0955820 Dec 08 11:34:14.986427 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-45f22a49-b6c7-4717-9416-73171b92fb22 req-38e1cddb-8311-4f7d-9d47-20f007284752 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe HTTP/1.1" status: 200 len: 1001 time: 0.0695968 Dec 08 11:34:15.049849 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f22a49-b6c7-4717-9416-73171b92fb22 req-21300a0d-5498-42a1-a5b7-2184b3385e44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:15.051349 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-45f22a49-b6c7-4717-9416-73171b92fb22 req-21300a0d-5498-42a1-a5b7-2184b3385e44 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 200 len: 855 time: 0.0565653 Dec 08 11:34:15.140644 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f22a49-b6c7-4717-9416-73171b92fb22 req-37dce440-ff74-4061-98a4-e1ff721e0925 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:15.142356 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-45f22a49-b6c7-4717-9416-73171b92fb22 req-37dce440-ff74-4061-98a4-e1ff721e0925 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=fd37a1fc-3614-462b-92a2-b41260c949a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0814021 Dec 08 11:34:15.271132 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-45f22a49-b6c7-4717-9416-73171b92fb22 req-672ce7e6-3498-438f-8613-0da352437518 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1006775 Dec 08 11:34:15.395640 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-45f22a49-b6c7-4717-9416-73171b92fb22 req-e2fc1a0b-14eb-4152-b37c-c0ba9367e914 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1110244 Dec 08 11:34:15.591673 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d9e28f-8657-479e-8a5f-e5c7d57403a6 req-900c3c61-447c-4052-8eac-0fc985d4fa96 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:15.593179 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20d9e28f-8657-479e-8a5f-e5c7d57403a6 req-900c3c61-447c-4052-8eac-0fc985d4fa96 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.1432261 Dec 08 11:34:15.606809 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f99af05-b4f5-4560-abe9-708e4665b957 req-c06b922c-780a-4151-ab55-9b4383a27f4e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:15.608273 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2f99af05-b4f5-4560-abe9-708e4665b957 req-c06b922c-780a-4151-ab55-9b4383a27f4e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.0774453 Dec 08 11:34:15.685115 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20d9e28f-8657-479e-8a5f-e5c7d57403a6 req-53789ad5-b23c-4662-ac01-a9988383047a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0757556 Dec 08 11:34:15.689444 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2f99af05-b4f5-4560-abe9-708e4665b957 req-f9e66747-2993-4cc4-ac4e-6e8e7732f2db tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732563 Dec 08 11:34:16.906093 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace11f34-a75d-439d-b86b-12116d22a4fa req-055fbf15-77ab-4f2a-9977-fc17f0120450 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:16.908697 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ace11f34-a75d-439d-b86b-12116d22a4fa req-055fbf15-77ab-4f2a-9977-fc17f0120450 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0965626 Dec 08 11:34:16.922405 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0ed1193-6b80-4699-aef1-94929369f1ea req-769c3135-1421-4a28-b4bb-f0922a2780e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:16.924333 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c0ed1193-6b80-4699-aef1-94929369f1ea req-769c3135-1421-4a28-b4bb-f0922a2780e4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.0764284 Dec 08 11:34:16.997591 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ace11f34-a75d-439d-b86b-12116d22a4fa req-a77367df-3f86-4781-9b09-09bad74f2122 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721567 Dec 08 11:34:17.013669 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c0ed1193-6b80-4699-aef1-94929369f1ea req-a6b15216-c4a4-4289-9e98-115b6c428209 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0802677 Dec 08 11:34:17.542641 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:18.179181 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6994835e-3de5-4754-8c60-f8c49b9f3ea7 req-bed7eecd-953e-4df5-b3ee-48fa47d264b6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:18.180659 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6994835e-3de5-4754-8c60-f8c49b9f3ea7 req-bed7eecd-953e-4df5-b3ee-48fa47d264b6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0782225 Dec 08 11:34:18.191922 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff80b973-0b0a-4d5e-980e-7fc5a6f6d637 req-ed08816f-08cc-462e-a0c7-48e530926133 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:18.193260 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ff80b973-0b0a-4d5e-980e-7fc5a6f6d637 req-ed08816f-08cc-462e-a0c7-48e530926133 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.0804019 Dec 08 11:34:18.264182 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6994835e-3de5-4754-8c60-f8c49b9f3ea7 req-e0644e90-aff4-46c0-9f0a-c2e030664d5d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699761 Dec 08 11:34:18.268160 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ff80b973-0b0a-4d5e-980e-7fc5a6f6d637 req-80139e26-2cf0-4acf-be45-579c1551722d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681183 Dec 08 11:34:18.981213 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7835f63f-2bba-4ccb-abd2-22b2dab6bbd3 req-f7e5850e-61c7-4ed8-846c-fe7e0cba6fa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:18.982737 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7835f63f-2bba-4ccb-abd2-22b2dab6bbd3 req-f7e5850e-61c7-4ed8-846c-fe7e0cba6fa3 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 1099 time: 0.0394044 Dec 08 11:34:19.033639 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7835f63f-2bba-4ccb-abd2-22b2dab6bbd3 req-6f9667e7-edf3-428c-ae73-420e7d70835e service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403681 Dec 08 11:34:19.419620 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4960437d-269b-4d9b-8ac9-60917eed6140 req-c54ae8d8-87ae-4ca6-b388-0d9191640b67 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:19.421184 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4960437d-269b-4d9b-8ac9-60917eed6140 req-c54ae8d8-87ae-4ca6-b388-0d9191640b67 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.0819182 Dec 08 11:34:19.434829 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fba73217-3c8b-4058-bcaa-6d60bf7802ec req-a4de74dd-c30b-4e26-b490-ad1b5a2c4b0c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:19.436529 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fba73217-3c8b-4058-bcaa-6d60bf7802ec req-a4de74dd-c30b-4e26-b490-ad1b5a2c4b0c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0884624 Dec 08 11:34:19.509029 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4960437d-269b-4d9b-8ac9-60917eed6140 req-c744adfa-f5a6-4d47-844b-178b14d19bb2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715246 Dec 08 11:34:19.518178 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fba73217-3c8b-4058-bcaa-6d60bf7802ec req-05586bb5-4653-4f35-9c01-e3b9b32cbaff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731072 Dec 08 11:34:20.660438 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd74a8b9-3744-499b-acd9-f485ed0eec3c req-4d32f688-021e-4aa1-a4c4-575d4661f282 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:20.661942 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fd74a8b9-3744-499b-acd9-f485ed0eec3c req-4d32f688-021e-4aa1-a4c4-575d4661f282 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.0805650 Dec 08 11:34:20.673713 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44440c82-1b73-40d3-afcd-b1668d30f230 req-fbec26e1-55ca-476a-8a1f-a9014cd7db41 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:20.675074 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-44440c82-1b73-40d3-afcd-b1668d30f230 req-fbec26e1-55ca-476a-8a1f-a9014cd7db41 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0650268 Dec 08 11:34:20.742771 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-44440c82-1b73-40d3-afcd-b1668d30f230 req-55eadb37-1a1c-41f0-b9cb-12bf7d830c10 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612590 Dec 08 11:34:20.750074 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fd74a8b9-3744-499b-acd9-f485ed0eec3c req-7e79ae79-f96c-43e9-b14a-22aa60263fe0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741088 Dec 08 11:34:20.819422 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 53350) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:34:20.866037 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_v2 [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Deleting subnet a2e78872-9414-489f-b73b-b06f4460aa93 {{(pid=102317) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:34:20.869071 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:20.905266 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:20.911781 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:20.963670 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for subnet, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:20.987109 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a2e78872-9414-489f-b73b-b06f4460aa93,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:20.997267 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:20.997640 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:20.997993 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:20.998378 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:20.998659 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:20.998993 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:20.999323 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:20.999653 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:20.999982 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:21.000307 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:21.000633 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:21.000954 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:21.001818 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:21.004609 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:21.007913 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-439d3697-38c4-472c-96d5-48d765755de9 admin admin] 10.222.0.66 "DELETE /v2.0/subnets/a2e78872-9414-489f-b73b-b06f4460aa93 HTTP/1.1" status: 204 len: 168 time: 0.1866560 Dec 08 11:34:21.010362 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 53354) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:34:21.082951 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:21.168674 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:21.190300 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.190696 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.191475 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.191841 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > port after_create 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.192167 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > port after_delete 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.192503 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > port after_update 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.192841 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.193186 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.193496 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.193822 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.308560 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.308916 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.309286 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.309629 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102317) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 08 11:34:21.309999 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1056c468-8569-46d3-ae01-3e9a87553272']}} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:34:21.328106 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c37df7a5-94f5-4cf8-8161-23e912b124b9') {'for_net_delete': True} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:34:21.328412 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c37df7a5-94f5-4cf8-8161-23e912b124b9') {} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:34:21.345175 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4850398'] for segment, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:21.365825 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:21.373884 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Releasing vlan 291 on physical network physnet1 to pool {{(pid=102317) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:34:21.374269 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5648505'] for segment, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: from cryptography.utils import int_from_bytes Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: from cryptography.utils import int_from_bytes Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: Traceback (most recent call last): Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: timer() Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: cb(*args, **kw) Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: return func(*args, **kwargs) Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: self._notify() Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: self.callback(batched_events) Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: event.method(event) Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: return f(self, *a, **k) Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._get(url).json() Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: return self.request(url, 'GET', **kwargs) Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:34:21.378758 dv-cinder-819778-3-iscsi neutron-server[102317]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:34:21.446024 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:21.453102 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:21.456455 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] 10.222.0.66 "DELETE /v2.0/networks/1056c468-8569-46d3-ae01-3e9a87553272 HTTP/1.1" status: 204 len: 168 time: 0.4451809 Dec 08 11:34:21.471646 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-801d5bdf-cd55-450c-86d6-6483cc21be1c admin admin] Pushing event deleted for resources: {'Network': ['ID=1056c468-8569-46d3-ae01-3e9a87553272,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:21.651198 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 53364) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:34:21.695049 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-19121d75-116c-494b-abe7-0066e0b1d234 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=bde1d456ccb0411eaed7cb4c5c07de7d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0426753 Dec 08 11:34:21.697432 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 53366) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:34:21.743959 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a10b50fa-46a0-4509-b32d-692600837417 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:21.764242 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a10b50fa-46a0-4509-b32d-692600837417 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:21.812306 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a10b50fa-46a0-4509-b32d-692600837417 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:21.815256 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a10b50fa-46a0-4509-b32d-692600837417 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:21.825266 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-a10b50fa-46a0-4509-b32d-692600837417 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/87031582-9f52-42b8-944f-dbb7215da8ae HTTP/1.1" status: 204 len: 168 time: 0.1184161 Dec 08 11:34:21.827487 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a10b50fa-46a0-4509-b32d-692600837417 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87031582-9f52-42b8-944f-dbb7215da8ae,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:21.939217 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58fe58fe-4fc9-407c-8278-24dbdf259ccc req-2ee64816-45d3-4b32-841a-f3d5623432f4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:21.940715 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-58fe58fe-4fc9-407c-8278-24dbdf259ccc req-2ee64816-45d3-4b32-841a-f3d5623432f4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0871294 Dec 08 11:34:21.952265 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0158dc67-dfcc-4c17-8ec1-da347c55d20a req-2e70f77f-9a53-4a6c-8f50-2798187c0e77 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:21.953726 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0158dc67-dfcc-4c17-8ec1-da347c55d20a req-2e70f77f-9a53-4a6c-8f50-2798187c0e77 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 943 time: 0.0889564 Dec 08 11:34:22.004315 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device be511646-f492-43f2-af08-bc641afcd8a2 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:34:22.019893 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-58fe58fe-4fc9-407c-8278-24dbdf259ccc req-6409ac58-ab2c-4355-ac21-9225e4d11d97 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646679 Dec 08 11:34:22.034871 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0158dc67-dfcc-4c17-8ec1-da347c55d20a req-1e26a4ae-e391-45d1-88e5-0079c1023458 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739481 Dec 08 11:34:22.118108 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port be511646-f492-43f2-af08-bc641afcd8a2, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=be511646-f492-43f2-af08-bc641afcd8a2,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:34:22.136936 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': 'be511646-f492-43f2-af08-bc641afcd8a2', 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919', 'port_id': 'be511646-f492-43f2-af08-bc641afcd8a2', 'mac_address': 'fa:16:3e:90:d5:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 277, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd6b1fb0e-d38f-47ca-a647-53b824c47e76', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:34:22.177683 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fddc3430-311b-41cd-882b-7b6b2d9e266c req-630ad066-417c-41ef-aafc-633c99a3a301 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:22.179259 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fddc3430-311b-41cd-882b-7b6b2d9e266c req-630ad066-417c-41ef-aafc-633c99a3a301 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0589316 Dec 08 11:34:22.188130 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:22.209659 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id be511646-f492-43f2-af08-bc641afcd8a2 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:34:22.230305 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port be511646-f492-43f2-af08-bc641afcd8a2, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=be511646-f492-43f2-af08-bc641afcd8a2,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:34:22.235320 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:22.235462 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fddc3430-311b-41cd-882b-7b6b2d9e266c req-26217f68-5179-4c27-9836-b24a20413478 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503151 Dec 08 11:34:22.289003 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=be511646-f492-43f2-af08-bc641afcd8a2,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:22.299050 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:22.299959 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:22.300790 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:22.301712 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:22.302358 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:22.303005 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:22.303550 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:22.304157 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:22.304659 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:22.305327 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:22.305683 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:22.306263 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:22.306830 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:22.457058 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2cd145ff-45a4-47e4-b07c-152c5f824c9c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:22.967712 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['be511646-f492-43f2-af08-bc641afcd8a2'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:34:23.244377 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d23248-e8f1-4919-8af4-7ba15b8e81f2 req-88056f79-661a-4d9e-8945-37dc6e971729 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:23.247330 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f5d23248-e8f1-4919-8af4-7ba15b8e81f2 req-88056f79-661a-4d9e-8945-37dc6e971729 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 944 time: 0.0647061 Dec 08 11:34:23.304797 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f5d23248-e8f1-4919-8af4-7ba15b8e81f2 req-ec65e539-b4ec-4906-90b4-db943e39e622 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524006 Dec 08 11:34:24.431086 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4626175c-a791-4d5f-870a-9315c231edd6 req-340b8f85-d859-4c20-ad06-913ddae3ede1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:24.432581 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4626175c-a791-4d5f-870a-9315c231edd6 req-340b8f85-d859-4c20-ad06-913ddae3ede1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 944 time: 0.0539649 Dec 08 11:34:24.483636 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4626175c-a791-4d5f-870a-9315c231edd6 req-450f8d2d-7bd7-4427-b059-032e424a0488 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450406 Dec 08 11:34:24.684970 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-c04cdffd-41bd-4fbf-8eab-f6bcb9a96b63 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:24.961695 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-620df21a-a8a3-45d1-acf0-5ec1f85a22c6 req-4b13f5a4-0961-488b-8baa-018777d870d7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:24.963204 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-620df21a-a8a3-45d1-acf0-5ec1f85a22c6 req-4b13f5a4-0961-488b-8baa-018777d870d7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0996835 Dec 08 11:34:24.969487 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-565ca181-39d9-4a44-b13e-187478f01e17 req-bddc0948-4fbb-4de7-b1c7-96e195fa4ee0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:24.970888 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-565ca181-39d9-4a44-b13e-187478f01e17 req-bddc0948-4fbb-4de7-b1c7-96e195fa4ee0 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=801ccccb4d7647de8e9558e07ebdc070&device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 1098 time: 0.0979769 Dec 08 11:34:25.067363 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-620df21a-a8a3-45d1-acf0-5ec1f85a22c6 req-2177f129-8193-4e85-8782-09376292ac83 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0954213 Dec 08 11:34:25.094953 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-565ca181-39d9-4a44-b13e-187478f01e17 req-01d717da-bd22-4b4d-b9c0-aaa8e1284b60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:25.096397 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-565ca181-39d9-4a44-b13e-187478f01e17 req-01d717da-bd22-4b4d-b9c0-aaa8e1284b60 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b799b290-99c1-4693-82cc-42bbd4d90adb HTTP/1.1" status: 200 len: 920 time: 0.1113248 Dec 08 11:34:25.147342 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-565ca181-39d9-4a44-b13e-187478f01e17 req-6f975219-8f8b-440a-8a9b-cb45ca4eec31 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=96b6dc81-7654-48f5-ac3f-e3e4d35982b3 HTTP/1.1" status: 200 len: 217 time: 0.0403316 Dec 08 11:34:25.197259 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-565ca181-39d9-4a44-b13e-187478f01e17 req-6f980286-d79e-4f7d-9d27-1a2ce89b3dd2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:25.199003 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-565ca181-39d9-4a44-b13e-187478f01e17 req-6f980286-d79e-4f7d-9d27-1a2ce89b3dd2 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59ab11c2-3db5-4069-afa6-b6f825d69316 HTTP/1.1" status: 200 len: 859 time: 0.0431650 Dec 08 11:34:25.235195 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-565ca181-39d9-4a44-b13e-187478f01e17 req-8ed9cf4b-cdf1-4326-ad99-3005217e9171 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b799b290-99c1-4693-82cc-42bbd4d90adb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0263107 Dec 08 11:34:25.337506 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-565ca181-39d9-4a44-b13e-187478f01e17 req-21416879-2f08-49a1-bfbc-9556abf32201 service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0886073 Dec 08 11:34:25.434515 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-565ca181-39d9-4a44-b13e-187478f01e17 req-92aa9827-ead2-4bec-a4af-d49535237f2e service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880055 Dec 08 11:34:25.606449 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9adfee50-3434-4ddd-9130-f5bd43639cc8 req-982e9db2-d404-48f5-859d-51d17de17d80 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:25.607844 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9adfee50-3434-4ddd-9130-f5bd43639cc8 req-982e9db2-d404-48f5-859d-51d17de17d80 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 944 time: 0.0534515 Dec 08 11:34:25.654568 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9adfee50-3434-4ddd-9130-f5bd43639cc8 req-e0b3c80e-e2b6-468e-8a3e-630b5af2ac3b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407510 Dec 08 11:34:25.764647 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:26.031249 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device be511646-f492-43f2-af08-bc641afcd8a2 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:34:26.080054 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port be511646-f492-43f2-af08-bc641afcd8a2 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:34:26.084067 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port be511646-f492-43f2-af08-bc641afcd8a2 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:34:26.084437 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:26.166396 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:26.184690 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a2c03cc-51ca-4e24-96ac-a6136ba29aa1 req-0f91121e-db2e-4594-859e-2ff8b9db5326 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:26.186335 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6a2c03cc-51ca-4e24-96ac-a6136ba29aa1 req-0f91121e-db2e-4594-859e-2ff8b9db5326 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0511003 Dec 08 11:34:26.190609 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '01a3f1c2-c5b6-4500-89f8-03ff7a2c4321', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be511646-f492-43f2-af08-bc641afcd8a2'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:34:26.192858 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-776d65d9-905b-41bd-aa71-2dfb214bd362" -d '{"events": [{"server_uuid": "01a3f1c2-c5b6-4500-89f8-03ff7a2c4321", "name": "network-vif-plugged", "status": "completed", "tag": "be511646-f492-43f2-af08-bc641afcd8a2"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:34:26.205734 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port be511646-f492-43f2-af08-bc641afcd8a2, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=be511646-f492-43f2-af08-bc641afcd8a2,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:34:26.212435 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:26.237004 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:34:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7b7e0c1-dbd5-4337-8999-66bacb18b2af x-openstack-request-id: req-c7b7e0c1-dbd5-4337-8999-66bacb18b2af {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:34:26.237331 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "01a3f1c2-c5b6-4500-89f8-03ff7a2c4321", "name": "network-vif-plugged", "status": "completed", "tag": "be511646-f492-43f2-af08-bc641afcd8a2", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:34:26.237590 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-c7b7e0c1-dbd5-4337-8999-66bacb18b2af {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:34:26.237979 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '01a3f1c2-c5b6-4500-89f8-03ff7a2c4321', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be511646-f492-43f2-af08-bc641afcd8a2', 'code': 200} Dec 08 11:34:26.244077 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6a2c03cc-51ca-4e24-96ac-a6136ba29aa1 req-56c71367-c176-44b9-8e5d-f9f5e7652b95 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509882 Dec 08 11:34:26.263692 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=be511646-f492-43f2-af08-bc641afcd8a2,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:26.450723 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c93e0c9-8bac-4b98-97e1-3a9a6c4e8d63 req-83538c40-a7c3-49aa-a25d-566f10c40338 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:26.452270 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2c93e0c9-8bac-4b98-97e1-3a9a6c4e8d63 req-83538c40-a7c3-49aa-a25d-566f10c40338 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 1098 time: 0.0481296 Dec 08 11:34:26.524634 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2c93e0c9-8bac-4b98-97e1-3a9a6c4e8d63 req-1b431166-e74b-47b5-8967-2af9379a4411 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580070 Dec 08 11:34:26.772591 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a383df33-6c2c-4c43-98bf-8a3a1160e78c req-32868988-8091-4937-8b1f-00146ec83cf8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:26.774008 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a383df33-6c2c-4c43-98bf-8a3a1160e78c req-32868988-8091-4937-8b1f-00146ec83cf8 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 945 time: 0.0483296 Dec 08 11:34:26.821800 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a383df33-6c2c-4c43-98bf-8a3a1160e78c req-4086abaa-2b00-42af-b5c9-56421e6fe6b2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411680 Dec 08 11:34:27.125980 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:27.358704 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eafacd6-5956-47ad-b856-26d6cfb4cc7d req-2a043a29-86a0-4517-8b8a-d67f84faab92 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:27.360213 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1eafacd6-5956-47ad-b856-26d6cfb4cc7d req-2a043a29-86a0-4517-8b8a-d67f84faab92 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0480328 Dec 08 11:34:27.409096 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1eafacd6-5956-47ad-b856-26d6cfb4cc7d req-ec253362-cea1-4f81-87fb-b3ed850b2ca4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430474 Dec 08 11:34:27.826568 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 53510) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:34:27.957052 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8961da63-e5f7-4373-b830-cac295cfc8cc req-1d33763c-1cf5-43a5-a70c-f8a1740f0c51 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:27.958566 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8961da63-e5f7-4373-b830-cac295cfc8cc req-1d33763c-1cf5-43a5-a70c-f8a1740f0c51 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 945 time: 0.0504072 Dec 08 11:34:27.988476 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b5e53059-1b81-4534-9faa-687c3f4a53fd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:28.009136 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8961da63-e5f7-4373-b830-cac295cfc8cc req-0953dfe4-62d8-4822-b0ad-2b6cbb34e18a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444038 Dec 08 11:34:28.078543 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b5e53059-1b81-4534-9faa-687c3f4a53fd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:28.085645 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b5e53059-1b81-4534-9faa-687c3f4a53fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:28.128022 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-b5e53059-1b81-4534-9faa-687c3f4a53fd admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=a02375d26faf406d9cf7e504b6db5084&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3003023 Dec 08 11:34:28.128890 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5e53059-1b81-4534-9faa-687c3f4a53fd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92c4017b-8015-4871-81ba-962da9131939,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:28.130707 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 53522) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:34:28.147911 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:28.180274 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:28.205068 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:28.251145 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:28.254241 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:28.255637 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/92c4017b-8015-4871-81ba-962da9131939 HTTP/1.1" status: 204 len: 168 time: 0.1238375 Dec 08 11:34:28.263168 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92c4017b-8015-4871-81ba-962da9131939,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:28.270766 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:28.271116 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:28.271464 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:28.271805 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:28.272135 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:28.272463 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:28.272795 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:28.273122 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:28.273481 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:28.273808 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:28.274129 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:28.274451 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:28.274773 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd5dbcd4-c481-4784-9b11-3248221f3c01 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:34:28.528250 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014abe8e-8faa-4f99-8ab6-d0542461ee7b req-7c1b03d9-93b2-4066-92b4-b23c90da5a94 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:28.529907 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-014abe8e-8faa-4f99-8ab6-d0542461ee7b req-7c1b03d9-93b2-4066-92b4-b23c90da5a94 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0535619 Dec 08 11:34:28.589537 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-014abe8e-8faa-4f99-8ab6-d0542461ee7b req-e6e53150-80bf-49b8-8345-a4b1b9c2a80e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525148 Dec 08 11:34:29.144898 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89834f93-ab95-43bc-893a-ad06d573e3c3 req-cbf48295-2126-4647-abf4-7e67075409b1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:29.159989 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-89834f93-ab95-43bc-893a-ad06d573e3c3 req-cbf48295-2126-4647-abf4-7e67075409b1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 945 time: 0.0748522 Dec 08 11:34:29.197442 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-89834f93-ab95-43bc-893a-ad06d573e3c3 req-dabb2a67-8936-4e1b-bd96-b85f1595dcd0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425205 Dec 08 11:34:29.707668 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3116bd59-6103-4ecc-b341-8a453fcc0905 req-c364b329-9a8c-447e-a36d-d5e34ed25ab0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:29.709160 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3116bd59-6103-4ecc-b341-8a453fcc0905 req-c364b329-9a8c-447e-a36d-d5e34ed25ab0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0508618 Dec 08 11:34:29.764858 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3116bd59-6103-4ecc-b341-8a453fcc0905 req-4289fe0b-84ba-4a31-8a97-c53358139eb5 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0497563 Dec 08 11:34:30.315966 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-336e6139-b0be-4f95-a4a8-3bc311516ee1 req-0e77c80a-0e79-4263-8ae4-bff96dceafaf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:30.317437 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-336e6139-b0be-4f95-a4a8-3bc311516ee1 req-0e77c80a-0e79-4263-8ae4-bff96dceafaf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 945 time: 0.0485072 Dec 08 11:34:30.368550 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-336e6139-b0be-4f95-a4a8-3bc311516ee1 req-cc426979-8dfc-4903-a759-9c81f065c199 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452299 Dec 08 11:34:30.898067 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a510efd-700f-48a2-be99-c18ff8828102 req-08a3e8d2-144a-4766-8a31-b7118a5c7cbb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:30.899537 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2a510efd-700f-48a2-be99-c18ff8828102 req-08a3e8d2-144a-4766-8a31-b7118a5c7cbb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0536189 Dec 08 11:34:30.946066 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2a510efd-700f-48a2-be99-c18ff8828102 req-6c14829b-0bda-4c4a-8db9-18df9ef93f06 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406704 Dec 08 11:34:32.064030 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3189da8b-4645-49f8-8449-8ba9d0d014a2 req-a61a44a9-944b-4a18-ab20-b55f0f9a558c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:32.065510 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3189da8b-4645-49f8-8449-8ba9d0d014a2 req-a61a44a9-944b-4a18-ab20-b55f0f9a558c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0517082 Dec 08 11:34:32.114451 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3189da8b-4645-49f8-8449-8ba9d0d014a2 req-da15a395-89ee-484d-9fc0-dac229d7026f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426414 Dec 08 11:34:33.229718 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418f8f75-a06a-4475-a572-e8c1afc1eb55 req-f291b398-7b3f-4da3-bcee-5b686e1543c8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:33.231316 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-418f8f75-a06a-4475-a572-e8c1afc1eb55 req-f291b398-7b3f-4da3-bcee-5b686e1543c8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0479419 Dec 08 11:34:33.278081 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-418f8f75-a06a-4475-a572-e8c1afc1eb55 req-b22a96b3-2754-4fa7-9253-76df2a2dd83b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407858 Dec 08 11:34:34.404778 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0183c812-1b55-460d-a890-3491e65222be req-79aa4638-cee2-45d7-ae2f-eba3680644e0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:34.406280 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0183c812-1b55-460d-a890-3491e65222be req-79aa4638-cee2-45d7-ae2f-eba3680644e0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0515556 Dec 08 11:34:34.451994 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0183c812-1b55-460d-a890-3491e65222be req-c497b17a-b75b-41a5-a59b-522468173be7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398960 Dec 08 11:34:35.564228 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bea3649-646e-49d0-8168-6510a1bd3493 req-81f13790-16fb-4e8c-847a-76183335cd45 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:35.565749 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4bea3649-646e-49d0-8168-6510a1bd3493 req-81f13790-16fb-4e8c-847a-76183335cd45 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0473003 Dec 08 11:34:35.610832 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4bea3649-646e-49d0-8168-6510a1bd3493 req-4f4ea1f9-2cf9-4bbe-b236-7301aada2136 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394058 Dec 08 11:34:36.720692 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf9bbea9-65b4-42c1-8c7e-ef9fef35ad03 req-ee6799a0-43d6-450c-bd3f-2da2544c1e72 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:36.722056 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf9bbea9-65b4-42c1-8c7e-ef9fef35ad03 req-ee6799a0-43d6-450c-bd3f-2da2544c1e72 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0465813 Dec 08 11:34:36.770089 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf9bbea9-65b4-42c1-8c7e-ef9fef35ad03 req-5fd4ad40-9dde-498e-ad84-4f4dc2052916 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422974 Dec 08 11:34:37.879328 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b34ffe0-eecc-46e5-93b8-4764bfa3929a req-2775cd05-1a1a-481d-a6f5-e597e93d8351 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:37.880772 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1b34ffe0-eecc-46e5-93b8-4764bfa3929a req-2775cd05-1a1a-481d-a6f5-e597e93d8351 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0468681 Dec 08 11:34:37.926638 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1b34ffe0-eecc-46e5-93b8-4764bfa3929a req-fef81cc8-d930-406d-92a9-5aa32f65cae4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400779 Dec 08 11:34:39.039733 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c638597-4d4b-4dec-afc5-6abf88e43814 req-2bb5712d-17b1-475f-a8de-9a971f9159be tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:39.041213 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2c638597-4d4b-4dec-afc5-6abf88e43814 req-2bb5712d-17b1-475f-a8de-9a971f9159be tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0487921 Dec 08 11:34:39.090470 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2c638597-4d4b-4dec-afc5-6abf88e43814 req-5deb2d0c-1748-48ec-9b72-766d6ad6ff37 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430067 Dec 08 11:34:40.206147 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a03998f-7b38-42e0-ae7a-6dc424b6f492 req-4192d2ac-2be2-451f-b0e0-bdde04984312 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:40.207577 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1a03998f-7b38-42e0-ae7a-6dc424b6f492 req-4192d2ac-2be2-451f-b0e0-bdde04984312 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0509036 Dec 08 11:34:40.253164 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1a03998f-7b38-42e0-ae7a-6dc424b6f492 req-80c379be-f571-45a7-b8f9-21d5643ec0d3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397279 Dec 08 11:34:41.272730 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39be9a50-b2e8-4e13-baa2-ebf6ae115fd6 req-0aa5a930-7ee5-447b-aac2-34d37a39e433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:41.274256 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-39be9a50-b2e8-4e13-baa2-ebf6ae115fd6 req-0aa5a930-7ee5-447b-aac2-34d37a39e433 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0553095 Dec 08 11:34:41.324651 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-39be9a50-b2e8-4e13-baa2-ebf6ae115fd6 req-193043f6-6cbc-4519-b4ad-f344ae8184fa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443833 Dec 08 11:34:41.373555 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f863fc7-7b0f-4c5b-a675-ce66f0db1c89 req-41b5e6a7-ed1f-4f5f-acc6-438d5338e406 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:41.374972 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5f863fc7-7b0f-4c5b-a675-ce66f0db1c89 req-41b5e6a7-ed1f-4f5f-acc6-438d5338e406 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0494268 Dec 08 11:34:41.427705 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5f863fc7-7b0f-4c5b-a675-ce66f0db1c89 req-4f36ba63-abd2-42ee-83df-86c165eaeaa5 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460424 Dec 08 11:34:41.826287 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cf873f0-9472-4f45-8f9c-3e1e513a3579 req-38be864d-370f-48d4-b8b8-09069db5d414 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:41.827732 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3cf873f0-9472-4f45-8f9c-3e1e513a3579 req-38be864d-370f-48d4-b8b8-09069db5d414 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0493572 Dec 08 11:34:41.879681 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3cf873f0-9472-4f45-8f9c-3e1e513a3579 req-c44f3198-6fd0-4c37-abf0-8b878aa08b4c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452199 Dec 08 11:34:42.459583 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-298ff1b4-f0f7-4cfe-9816-216e8f00c4d0 req-245675f3-fdb3-47c6-9b91-90bec7babade tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:42.461064 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-298ff1b4-f0f7-4cfe-9816-216e8f00c4d0 req-245675f3-fdb3-47c6-9b91-90bec7babade tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0639091 Dec 08 11:34:42.510334 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-298ff1b4-f0f7-4cfe-9816-216e8f00c4d0 req-de374035-cda6-4ba2-a456-3ced3eec61f7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432954 Dec 08 11:34:42.647974 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac7c49b4-1fac-4003-9ba0-cf46fa0db423 req-fab34f97-8a69-487c-bbed-0f728f5c6d8b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:42.649475 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ac7c49b4-1fac-4003-9ba0-cf46fa0db423 req-fab34f97-8a69-487c-bbed-0f728f5c6d8b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0589511 Dec 08 11:34:42.695904 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ac7c49b4-1fac-4003-9ba0-cf46fa0db423 req-b6bc96dd-fe16-48c0-a065-52e104bae271 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405424 Dec 08 11:34:43.002442 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0869b7-c72e-4760-b381-935fd342790e req-023ffb43-66ad-4156-ad70-cbc25cbd0b12 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:43.004522 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0d0869b7-c72e-4760-b381-935fd342790e req-023ffb43-66ad-4156-ad70-cbc25cbd0b12 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0534129 Dec 08 11:34:43.049682 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0d0869b7-c72e-4760-b381-935fd342790e req-ec6133f4-abe4-4167-a185-91197e3282bc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0391757 Dec 08 11:34:43.649040 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba423991-ebb8-40c3-ad35-2aeec71bc4d1 req-5f5620a6-30f8-4399-b6f7-06f5a72eb960 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:43.650591 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ba423991-ebb8-40c3-ad35-2aeec71bc4d1 req-5f5620a6-30f8-4399-b6f7-06f5a72eb960 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0641897 Dec 08 11:34:43.681041 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 53838) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:34:43.702675 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ba423991-ebb8-40c3-ad35-2aeec71bc4d1 req-7853ded1-eceb-497e-b697-c5c3472710f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460699 Dec 08 11:34:43.787657 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e5e14440-c6ff-440d-8f15-733a67255111 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:43.819735 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8accf8ae-453f-4dbf-9aed-1e8a39669997 req-9f8be625-f734-4f7e-babd-13080eb7d66c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:43.821381 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8accf8ae-453f-4dbf-9aed-1e8a39669997 req-9f8be625-f734-4f7e-babd-13080eb7d66c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0564506 Dec 08 11:34:43.862162 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e5e14440-c6ff-440d-8f15-733a67255111 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:43.866138 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e5e14440-c6ff-440d-8f15-733a67255111 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:43.869040 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8accf8ae-453f-4dbf-9aed-1e8a39669997 req-bfdcd3cc-364b-471e-a221-da8dadcde8d7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415683 Dec 08 11:34:43.905566 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-e5e14440-c6ff-440d-8f15-733a67255111 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=aece39d70bc84ce5adb7dc02d273a690&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2227330 Dec 08 11:34:43.906879 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5e14440-c6ff-440d-8f15-733a67255111 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f3aca48f-0cba-46e4-be27-b90ca4c5607a,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:43.907924 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 53846) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:34:43.956353 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dad418bb-d9fb-4e00-aaa6-202ccdcae16b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:43.979098 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dad418bb-d9fb-4e00-aaa6-202ccdcae16b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:44.047123 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ef4f14-784a-49a4-8aa2-e7aa03c22752 req-637c0bff-e3a5-4c63-8938-07b297d9354b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:44.048581 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c1ef4f14-784a-49a4-8aa2-e7aa03c22752 req-637c0bff-e3a5-4c63-8938-07b297d9354b service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 1098 time: 0.0417869 Dec 08 11:34:44.053012 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dad418bb-d9fb-4e00-aaa6-202ccdcae16b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:44.055514 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dad418bb-d9fb-4e00-aaa6-202ccdcae16b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:44.056503 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-dad418bb-d9fb-4e00-aaa6-202ccdcae16b admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/f3aca48f-0cba-46e4-be27-b90ca4c5607a HTTP/1.1" status: 204 len: 168 time: 0.1476047 Dec 08 11:34:44.069202 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dad418bb-d9fb-4e00-aaa6-202ccdcae16b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3aca48f-0cba-46e4-be27-b90ca4c5607a,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:44.111231 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c1ef4f14-784a-49a4-8aa2-e7aa03c22752 req-7c743822-a630-4ec1-a602-a8d419f9d933 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474827 Dec 08 11:34:44.179419 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50d98ac3-924f-483e-a8b0-20d3e414b7bc req-d61cda0f-b239-4bd9-9ce5-a7d81a02e63e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:44.180894 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-50d98ac3-924f-483e-a8b0-20d3e414b7bc req-d61cda0f-b239-4bd9-9ce5-a7d81a02e63e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0503700 Dec 08 11:34:44.236578 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-50d98ac3-924f-483e-a8b0-20d3e414b7bc req-2da30b5d-2010-4782-ba5d-fe82f233b6f3 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0494180 Dec 08 11:34:44.828774 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39b6336c-159e-455f-98e8-1c8e58bc5e1c req-9380cdff-fd32-4060-a3d3-ed45eb98db33 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:44.830318 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-39b6336c-159e-455f-98e8-1c8e58bc5e1c req-9380cdff-fd32-4060-a3d3-ed45eb98db33 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0547919 Dec 08 11:34:44.877380 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-39b6336c-159e-455f-98e8-1c8e58bc5e1c req-42812e70-ee67-4e45-8ff2-688872b5268b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398610 Dec 08 11:34:44.980175 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba56d435-fa1a-4d06-851d-c5a86b0ff512 req-e63b7784-12fb-480d-aa2d-a35ccdf9cd22 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:44.981628 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ba56d435-fa1a-4d06-851d-c5a86b0ff512 req-e63b7784-12fb-480d-aa2d-a35ccdf9cd22 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0471056 Dec 08 11:34:45.027828 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ba56d435-fa1a-4d06-851d-c5a86b0ff512 req-c32efcbf-7e58-4859-a08f-0404432f05e1 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403931 Dec 08 11:34:45.349526 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f645636-e165-4343-91a1-d8ea773a8c5c req-25c53981-3aa5-4e16-94b2-10ac0e2e414a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:45.350950 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0f645636-e165-4343-91a1-d8ea773a8c5c req-25c53981-3aa5-4e16-94b2-10ac0e2e414a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0479550 Dec 08 11:34:45.624858 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0f645636-e165-4343-91a1-d8ea773a8c5c req-f33993df-ca8e-492e-a37b-c8eb38bf2804 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2681608 Dec 08 11:34:45.992021 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068f8b13-7e0a-4efa-a2f7-f8ffd298d655 req-56b870e3-bf07-4c7c-a974-e4621e478690 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:45.993466 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-068f8b13-7e0a-4efa-a2f7-f8ffd298d655 req-56b870e3-bf07-4c7c-a974-e4621e478690 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0461786 Dec 08 11:34:46.039146 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-068f8b13-7e0a-4efa-a2f7-f8ffd298d655 req-1992f2ab-0960-4f4f-bf6f-d53a2d89dd24 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398314 Dec 08 11:34:46.139603 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0d3d39b-c944-45f5-9937-75fc09d91c72 req-2df58c51-76e2-4488-811f-7cd7031df44d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:46.140941 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a0d3d39b-c944-45f5-9937-75fc09d91c72 req-2df58c51-76e2-4488-811f-7cd7031df44d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0473876 Dec 08 11:34:46.188343 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a0d3d39b-c944-45f5-9937-75fc09d91c72 req-b28a4ae5-4a3b-448a-9250-1729c0c18b9c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409145 Dec 08 11:34:46.739147 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0d4101f-a1c5-44fd-9d34-d8a3302a5998 req-e4f7a196-0228-4a73-9c9c-772cdb0b50e1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:46.740580 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a0d4101f-a1c5-44fd-9d34-d8a3302a5998 req-e4f7a196-0228-4a73-9c9c-772cdb0b50e1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0497527 Dec 08 11:34:46.787469 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a0d4101f-a1c5-44fd-9d34-d8a3302a5998 req-927a7ecd-5475-42db-9357-688da9a9053e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408075 Dec 08 11:34:47.159025 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04c7e0d-84f9-4e20-8be9-8ce2198ba33a req-b48b87df-ed15-4783-b94a-98392043e259 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:47.161208 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b04c7e0d-84f9-4e20-8be9-8ce2198ba33a req-b48b87df-ed15-4783-b94a-98392043e259 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0512109 Dec 08 11:34:47.208069 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b04c7e0d-84f9-4e20-8be9-8ce2198ba33a req-59e1b45f-6267-4c66-bef0-4d69a65832e4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412395 Dec 08 11:34:47.302320 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef9c7686-db31-43ff-8567-7d535dc34cf4 req-af4cfc83-4783-458f-a393-807808043dbb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:47.303912 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ef9c7686-db31-43ff-8567-7d535dc34cf4 req-af4cfc83-4783-458f-a393-807808043dbb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0506067 Dec 08 11:34:47.349036 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ef9c7686-db31-43ff-8567-7d535dc34cf4 req-897d7fa2-0b88-4d32-8cf6-4f5baa790ac0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393693 Dec 08 11:34:47.533024 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:47.615218 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e5cb5b9-887d-4d38-b4cc-dd83cd1fba83 req-d8996103-5fa1-43d8-b491-90be6a4b976f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:47.616682 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2e5cb5b9-887d-4d38-b4cc-dd83cd1fba83 req-d8996103-5fa1-43d8-b491-90be6a4b976f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0772932 Dec 08 11:34:47.618376 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e req-561a4a8b-1e2c-44a8-b71e-1b71302ea8ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:47.619694 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e req-561a4a8b-1e2c-44a8-b71e-1b71302ea8ec service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=801ccccb4d7647de8e9558e07ebdc070&device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 1098 time: 0.0676062 Dec 08 11:34:47.705008 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2e5cb5b9-887d-4d38-b4cc-dd83cd1fba83 req-712a3376-ef9d-4692-9ad9-334b9151704d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822840 Dec 08 11:34:47.740295 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e req-5ceda469-6180-44ec-a388-5e16c40cb6cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:47.741799 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e req-5ceda469-6180-44ec-a388-5e16c40cb6cc service neutron] 10.222.0.61 "GET /v2.0/networks?id=b799b290-99c1-4693-82cc-42bbd4d90adb HTTP/1.1" status: 200 len: 920 time: 0.1004112 Dec 08 11:34:47.787374 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e req-ac361781-8089-415b-ace8-9da08a17d5ed service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=96b6dc81-7654-48f5-ac3f-e3e4d35982b3 HTTP/1.1" status: 200 len: 217 time: 0.0346718 Dec 08 11:34:47.847564 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e req-e44c1fc7-1c41-4fcf-881c-79b8220daf6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:47.849336 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e req-e44c1fc7-1c41-4fcf-881c-79b8220daf6e service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59ab11c2-3db5-4069-afa6-b6f825d69316 HTTP/1.1" status: 200 len: 859 time: 0.0510969 Dec 08 11:34:47.894452 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:34:47.903592 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e req-cbad87c9-a4a6-475c-aafd-7f88cee5e300 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b799b290-99c1-4693-82cc-42bbd4d90adb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0435512 Dec 08 11:34:47.925203 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-486f5abf-3e53-4239-9c68-dee80f72f223 req-8cb3a10b-81dc-42ee-ae28-4bcc69d2fd7a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:47.926563 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-486f5abf-3e53-4239-9c68-dee80f72f223 req-8cb3a10b-81dc-42ee-ae28-4bcc69d2fd7a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0589759 Dec 08 11:34:48.027435 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-486f5abf-3e53-4239-9c68-dee80f72f223 req-0abe4d19-b98a-41bb-96e0-840a277a273f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0932200 Dec 08 11:34:48.043565 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e req-e38563dd-5285-4cf1-ace4-38b9732d74f2 service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1161084 Dec 08 11:34:48.135901 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-61fa56c6-dbaf-4747-9b1e-dbfc6692062e req-7e858c0f-57c5-4d55-a4ec-0a22f37e669a service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0790014 Dec 08 11:34:48.328669 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77cfca3d-1186-46f5-8d17-ecc899f13721 req-1c7d3643-4151-4f7a-a012-c9b8f7a8c3ba tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:48.330131 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-77cfca3d-1186-46f5-8d17-ecc899f13721 req-1c7d3643-4151-4f7a-a012-c9b8f7a8c3ba tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0517256 Dec 08 11:34:48.376068 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-77cfca3d-1186-46f5-8d17-ecc899f13721 req-32845e16-b5d5-41ac-8045-89ff47b4bb77 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398860 Dec 08 11:34:48.818190 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deb2f9bc-6008-4599-9caa-5340ee1e4ae4 req-fd0a5e21-2cdb-4079-a258-764135b0423b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:48.819659 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-deb2f9bc-6008-4599-9caa-5340ee1e4ae4 req-fd0a5e21-2cdb-4079-a258-764135b0423b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0479314 Dec 08 11:34:48.866150 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-deb2f9bc-6008-4599-9caa-5340ee1e4ae4 req-129d3e42-bf7c-4c6d-89b9-f89a9f531872 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406334 Dec 08 11:34:49.140693 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72124b5c-cd76-4fa2-9acf-15e61503b0ee req-3dfed750-afee-496b-adf8-59de25110d46 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:49.142152 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72124b5c-cd76-4fa2-9acf-15e61503b0ee req-3dfed750-afee-496b-adf8-59de25110d46 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0469069 Dec 08 11:34:49.192176 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72124b5c-cd76-4fa2-9acf-15e61503b0ee req-6bc12a0d-d886-4026-8dcc-8746a49c6b06 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432227 Dec 08 11:34:49.489952 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d48e37-d348-4cce-875f-a0ca9274303c req-50abc6e8-32c7-47d5-8980-ea6501926367 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:49.491374 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e3d48e37-d348-4cce-875f-a0ca9274303c req-50abc6e8-32c7-47d5-8980-ea6501926367 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0472515 Dec 08 11:34:49.536527 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e3d48e37-d348-4cce-875f-a0ca9274303c req-3c68142a-f263-4a8e-b42d-bb53661086e0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393777 Dec 08 11:34:49.978869 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06c7fd67-dbde-4ec3-bc34-ea62f766cdf8 req-4688b911-db1a-4e14-98df-579118fd6c22 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:49.980411 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-06c7fd67-dbde-4ec3-bc34-ea62f766cdf8 req-4688b911-db1a-4e14-98df-579118fd6c22 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0482781 Dec 08 11:34:50.031385 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-06c7fd67-dbde-4ec3-bc34-ea62f766cdf8 req-ca8a1805-0e0f-4eda-bd2c-99910fe37fcd tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446398 Dec 08 11:34:50.318878 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbb666d9-357c-4c4b-a68d-d8d57218a678 req-e7b468ab-adcc-44fd-a803-b00d0c6a45c5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:50.320362 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bbb666d9-357c-4c4b-a68d-d8d57218a678 req-e7b468ab-adcc-44fd-a803-b00d0c6a45c5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0597358 Dec 08 11:34:50.368361 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bbb666d9-357c-4c4b-a68d-d8d57218a678 req-1677e19f-79cf-4dd1-95e7-41197e1a95cd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418501 Dec 08 11:34:50.654047 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f384382f-7cce-4e4f-8318-9fc8e476e316 req-e8987585-f422-4c48-8769-96f79051224b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:50.655477 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f384382f-7cce-4e4f-8318-9fc8e476e316 req-e8987585-f422-4c48-8769-96f79051224b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0471439 Dec 08 11:34:50.700773 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f384382f-7cce-4e4f-8318-9fc8e476e316 req-f135abd5-95e5-4208-a53c-ccb684a5182b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390399 Dec 08 11:34:51.145623 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06f5f12e-1f27-4614-a4c3-69f27fdcd51b req-54276614-0ed9-4584-8a7e-7627d17c763c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:51.147260 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-06f5f12e-1f27-4614-a4c3-69f27fdcd51b req-54276614-0ed9-4584-8a7e-7627d17c763c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0481036 Dec 08 11:34:51.199133 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-06f5f12e-1f27-4614-a4c3-69f27fdcd51b req-082bddf1-ed78-42f1-aed1-34a29a715eff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459936 Dec 08 11:34:51.484227 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89cb5ebd-0312-4b3d-bd55-20fc3878f87c req-d3ebbf81-f83f-4ac3-af85-31a423203926 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:51.485719 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-89cb5ebd-0312-4b3d-bd55-20fc3878f87c req-d3ebbf81-f83f-4ac3-af85-31a423203926 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0479572 Dec 08 11:34:51.532950 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-89cb5ebd-0312-4b3d-bd55-20fc3878f87c req-ef1a3275-e09d-49b3-b0b1-ecff172c58a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413487 Dec 08 11:34:51.817097 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66eb59c5-e423-4855-a8e0-5a3b58d92a3f req-ed88e73b-67ae-40fd-9587-dea875d4859e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:51.818569 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-66eb59c5-e423-4855-a8e0-5a3b58d92a3f req-ed88e73b-67ae-40fd-9587-dea875d4859e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0480201 Dec 08 11:34:51.863823 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-66eb59c5-e423-4855-a8e0-5a3b58d92a3f req-13ddd777-7988-4508-b360-c034a9370602 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392463 Dec 08 11:34:52.315937 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9c7977-bbed-43d6-a605-f804fba24286 req-9f5bcf46-cbe7-476d-9721-5898a5b3fa97 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:52.317422 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ca9c7977-bbed-43d6-a605-f804fba24286 req-9f5bcf46-cbe7-476d-9721-5898a5b3fa97 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0517735 Dec 08 11:34:52.364783 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ca9c7977-bbed-43d6-a605-f804fba24286 req-5ea855ee-4faa-4489-8fcd-319ddb31cb2d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403860 Dec 08 11:34:52.458630 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2ea3ced8-b50d-4f8f-acb8-45ffca0c8c28 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:52.646474 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee2433f8-d47d-4898-b9fe-63a95058e844 req-63a92a73-e1dc-4172-99d4-d3200191eae1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:52.648035 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ee2433f8-d47d-4898-b9fe-63a95058e844 req-63a92a73-e1dc-4172-99d4-d3200191eae1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0487864 Dec 08 11:34:52.695117 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ee2433f8-d47d-4898-b9fe-63a95058e844 req-86a6be04-a879-441c-adb7-af20d48f806d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411112 Dec 08 11:34:52.985855 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ddce298-229f-4c7d-8d3b-cc621f0ec327 req-d9d39337-3595-4778-9a02-6dc326a72dbb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:52.987405 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1ddce298-229f-4c7d-8d3b-cc621f0ec327 req-d9d39337-3595-4778-9a02-6dc326a72dbb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0539691 Dec 08 11:34:53.037485 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1ddce298-229f-4c7d-8d3b-cc621f0ec327 req-407677ba-c1ac-4284-8f9c-7dddff6c71db tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422304 Dec 08 11:34:53.482790 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe3fe43-0b7f-4d6b-8d97-b3a376730a8d req-16c67eb7-59b2-43c1-a7ab-0406f550dacb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:53.484171 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe3fe43-0b7f-4d6b-8d97-b3a376730a8d req-16c67eb7-59b2-43c1-a7ab-0406f550dacb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0554118 Dec 08 11:34:53.530567 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe3fe43-0b7f-4d6b-8d97-b3a376730a8d req-3b504444-e4a5-460d-81d1-599573a5b6eb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399802 Dec 08 11:34:53.825501 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961218e2-cd4f-4536-9d57-43ef8d0ff45b req-aa983f2a-0f5f-4374-a8c4-db6df324f0c6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:53.827131 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-961218e2-cd4f-4536-9d57-43ef8d0ff45b req-aa983f2a-0f5f-4374-a8c4-db6df324f0c6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0516117 Dec 08 11:34:53.876223 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-961218e2-cd4f-4536-9d57-43ef8d0ff45b req-094d4e6d-ba43-4bae-a258-9b82133db86d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422730 Dec 08 11:34:54.153478 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bdab52d-2e59-48f4-8668-55305ed695a8 req-1f90e9d6-3a69-41ab-88fa-d2070b70d360 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:54.154928 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8bdab52d-2e59-48f4-8668-55305ed695a8 req-1f90e9d6-3a69-41ab-88fa-d2070b70d360 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0487580 Dec 08 11:34:54.204161 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8bdab52d-2e59-48f4-8668-55305ed695a8 req-69976753-be52-4663-be45-225b64de20f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425119 Dec 08 11:34:54.687245 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-6b27998a-7d92-4cd4-bc38-19189699c5fc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:54.938362 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578c51a8-eb2f-49ae-be82-5fea9b0e7f58 req-9612febe-3e35-4e72-bf5e-8846091dbea0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:54.939852 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-578c51a8-eb2f-49ae-be82-5fea9b0e7f58 req-9612febe-3e35-4e72-bf5e-8846091dbea0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0495143 Dec 08 11:34:55.021591 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567f3ef5-0bec-4f73-a60e-25b253ba1d5e req-ca674121-7344-45e1-b5b3-2da2e2262859 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:55.023045 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-567f3ef5-0bec-4f73-a60e-25b253ba1d5e req-ca674121-7344-45e1-b5b3-2da2e2262859 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0782645 Dec 08 11:34:55.026595 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-578c51a8-eb2f-49ae-be82-5fea9b0e7f58 req-ac1f1c27-17c7-4199-b2eb-df7672d86389 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735795 Dec 08 11:34:55.070156 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-567f3ef5-0bec-4f73-a60e-25b253ba1d5e req-8ce90a1b-6f89-4919-8c89-e80469b3e6f6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412443 Dec 08 11:34:55.336509 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d4fff5-6e84-44ce-88a3-6144e5cbcd95 req-d1a09f37-c1e6-432f-8b0e-fa99ec243088 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:55.338089 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-67d4fff5-6e84-44ce-88a3-6144e5cbcd95 req-d1a09f37-c1e6-432f-8b0e-fa99ec243088 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0601132 Dec 08 11:34:55.405554 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-67d4fff5-6e84-44ce-88a3-6144e5cbcd95 req-dd24f780-9280-43d5-94fa-3f6cccd3dc08 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0594351 Dec 08 11:34:55.482053 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-c5d7127a-6a2d-4f45-aad5-44cf8650d778 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-201663082&fields=id&tenant_id=23027f58b51142389f64405702a0fcd3 HTTP/1.1" status: 200 len: 267 time: 0.0434773 Dec 08 11:34:55.587148 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-7bcde2da-d4c6-4939-9018-1b2faf760c72 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:55.588566 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-7bcde2da-d4c6-4939-9018-1b2faf760c72 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/networks?id=55a129bc-8ce3-4aac-98fb-64f16c4a4949 HTTP/1.1" status: 200 len: 809 time: 0.1000302 Dec 08 11:34:55.603730 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-aa7cfba7-5ac9-4d04-a789-c08f5b0b9fe7 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/quotas/23027f58b51142389f64405702a0fcd3 HTTP/1.1" status: 200 len: 375 time: 0.0093727 Dec 08 11:34:55.654369 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-dd456ab9-4952-498c-a81d-b71fc9a2380f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=23027f58b51142389f64405702a0fcd3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0455098 Dec 08 11:34:55.753054 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-6ad14b7c-6c7e-4397-b484-2ede6ba9454b service neutron] 10.222.0.66 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0862060 Dec 08 11:34:55.768966 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:55.842458 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-a346bf36-3bca-47ca-82aa-ea1a9ef946cb service neutron] 10.222.0.66 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834532 Dec 08 11:34:56.125435 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b7a90ddd-309e-4122-8cb8-850c422a69d2 req-2c02f416-649a-463c-90cb-403844874e5a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 210 time: 0.0354986 Dec 08 11:34:56.198808 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc3b908-4fe8-49e8-b71a-98978339adf2 req-2acd25ef-851f-432d-8dcf-b0c2378ef754 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:56.200336 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fcc3b908-4fe8-49e8-b71a-98978339adf2 req-2acd25ef-851f-432d-8dcf-b0c2378ef754 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0514989 Dec 08 11:34:56.250321 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fcc3b908-4fe8-49e8-b71a-98978339adf2 req-1f82ef33-5a90-4554-8cdc-1e67c56fb71c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433738 Dec 08 11:34:56.527610 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489dd35c-5a88-48b7-91b5-c4baaac5513e req-6cc709c8-c8e5-483d-920b-8840a5bc9371 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:56.528954 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-489dd35c-5a88-48b7-91b5-c4baaac5513e req-6cc709c8-c8e5-483d-920b-8840a5bc9371 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0481708 Dec 08 11:34:56.575883 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-489dd35c-5a88-48b7-91b5-c4baaac5513e req-9dc76108-2eeb-4c60-8ca3-97ba95835b13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402265 Dec 08 11:34:57.128905 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:57.243203 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a38d5370-59f6-4852-bf08-02f081988fe6 req-6237dd6b-24ba-4e9e-90f1-e286a81faa94 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 210 time: 0.0341647 Dec 08 11:34:57.286213 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-5cf87120-a2f8-4419-8f4a-8a9effa0ffa5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:57.287718 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-5cf87120-a2f8-4419-8f4a-8a9effa0ffa5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.61 "GET /v2.0/networks?id=55a129bc-8ce3-4aac-98fb-64f16c4a4949 HTTP/1.1" status: 200 len: 809 time: 0.1312940 Dec 08 11:34:57.388469 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-a03e2065-db8b-40c4-a283-73efc28a99bf tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=23027f58b51142389f64405702a0fcd3 HTTP/1.1" status: 200 len: 379 time: 0.0844281 Dec 08 11:34:57.401002 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aec7625-1ebf-4054-a820-756a2baedeba req-ed0a1484-ab31-43ae-bbe3-693933097491 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:57.402577 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4aec7625-1ebf-4054-a820-756a2baedeba req-ed0a1484-ab31-43ae-bbe3-693933097491 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0786843 Dec 08 11:34:57.407093 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-0bd951ba-cde0-4818-8d0d-4db086bced89 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Request body: {'port': {'device_id': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'admin_state_up': True, 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'security_groups': ['e5627452-bf2d-4afd-bd70-91f75757db97']}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:34:57.511622 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4aec7625-1ebf-4054-a820-756a2baedeba req-b39c9502-13f9-485f-96f7-89c609ab4c71 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0994284 Dec 08 11:34:57.557294 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-0bd951ba-cde0-4818-8d0d-4db086bced89 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Made reservation on behalf of 23027f58b51142389f64405702a0fcd3 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:34:57.560870 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-0bd951ba-cde0-4818-8d0d-4db086bced89 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:57.731185 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-0bd951ba-cde0-4818-8d0d-4db086bced89 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Allocated IP 172.20.0.5 (55a129bc-8ce3-4aac-98fb-64f16c4a4949/59081569-032b-42c0-afce-26c79ceb7aac/79e98205-d459-4886-827e-71b058999e30) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:34:57.740616 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1da342c-35a4-4fdc-a9ad-f71627b16300 req-711c22bf-2bdd-4f57-8fbc-26035b13d7ca tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:57.742131 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d1da342c-35a4-4fdc-a9ad-f71627b16300 req-711c22bf-2bdd-4f57-8fbc-26035b13d7ca tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0880196 Dec 08 11:34:57.829647 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d1da342c-35a4-4fdc-a9ad-f71627b16300 req-a5b9982f-b80d-483e-b9cd-1a81a1ac90d5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0800321 Dec 08 11:34:57.910680 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-0bd951ba-cde0-4818-8d0d-4db086bced89 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:57.942996 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-0bd951ba-cde0-4818-8d0d-4db086bced89 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:57.983389 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-0bd951ba-cde0-4818-8d0d-4db086bced89 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:34:57.989043 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-0bd951ba-cde0-4818-8d0d-4db086bced89 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:34:57.992706 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-0bd951ba-cde0-4818-8d0d-4db086bced89 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:34:57.998994 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bd951ba-cde0-4818-8d0d-4db086bced89 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Pushing event updated for resources: {'Port': ['ID=79e98205-d459-4886-827e-71b058999e30,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:58.048166 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-0bd951ba-cde0-4818-8d0d-4db086bced89 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:58.048793 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-0bd951ba-cde0-4818-8d0d-4db086bced89 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:58.066069 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-0bd951ba-cde0-4818-8d0d-4db086bced89 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6618493 Dec 08 11:34:58.079233 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Request body: {'port': {'device_id': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:34:58.134405 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:58.153923 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:58.200320 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-610ead03-e7f3-4092-8c9d-375044d4a9b9 None None] Provisioning complete for port 79e98205-d459-4886-827e-71b058999e30 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:34:58.200700 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-610ead03-e7f3-4092-8c9d-375044d4a9b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:58.234301 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-610ead03-e7f3-4092-8c9d-375044d4a9b9 None None] Port 79e98205-d459-4886-827e-71b058999e30 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:34:58.389273 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6bd3fcc-c2fa-433e-8d50-1f42334d6b95 req-344904dc-6e26-48f8-95ff-1f9907d74f82 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:58.390714 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b6bd3fcc-c2fa-433e-8d50-1f42334d6b95 req-344904dc-6e26-48f8-95ff-1f9907d74f82 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 931 time: 0.0791364 Dec 08 11:34:58.460782 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 79e98205-d459-4886-827e-71b058999e30 {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:34:58.475850 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:58.484955 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b6bd3fcc-c2fa-433e-8d50-1f42334d6b95 req-fd3a900a-fd60-4b8e-851d-ed4da888356f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0857129 Dec 08 11:34:58.493463 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Transition to ACTIVE for port object 79e98205-d459-4886-827e-71b058999e30 will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:34:58.497539 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:58.567050 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Pushing event updated for resources: {'Port': ['ID=79e98205-d459-4886-827e-71b058999e30,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:58.647261 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Attempting to bind port 79e98205-d459-4886-827e-71b058999e30 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:34:58.647597 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Attempting to bind port 79e98205-d459-4886-827e-71b058999e30 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': '0f102544-c85b-462f-95c4-8c4e0e813aa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:34:58.647927 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Attempting to bind port 79e98205-d459-4886-827e-71b058999e30 on network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:34:58.667696 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdfc896-909a-4da3-aa72-8fd90913cf58 req-d7f5eada-1af6-425f-96d5-5ffa5a400044 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:58.667925 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9fdfc896-909a-4da3-aa72-8fd90913cf58 req-d7f5eada-1af6-425f-96d5-5ffa5a400044 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0712225 Dec 08 11:34:58.668533 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Port 79e98205-d459-4886-827e-71b058999e30 on network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:34:58.668854 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Attempting to bind port 79e98205-d459-4886-827e-71b058999e30 on network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:34:58.680438 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 34, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:34:58.680769 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Checking segment: {'id': '0f102544-c85b-462f-95c4-8c4e0e813aa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:34:58.681143 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Bound using segment: {'id': '0f102544-c85b-462f-95c4-8c4e0e813aa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:34:58.681607 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Bound port: 79e98205-d459-4886-827e-71b058999e30, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0f102544-c85b-462f-95c4-8c4e0e813aa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 262, 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:34:58.681961 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:58.756305 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9fdfc896-909a-4da3-aa72-8fd90913cf58 req-00907d5a-59d9-430e-8f59-77413c417834 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0820098 Dec 08 11:34:58.777173 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] For port 79e98205-d459-4886-827e-71b058999e30, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:34:58.780681 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] For port 79e98205-d459-4886-827e-71b058999e30, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=79e98205-d459-4886-827e-71b058999e30,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:34:58.785926 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:58.820134 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:58.820763 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:34:58.822169 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] 10.222.0.61 "PUT /v2.0/ports/79e98205-d459-4886-827e-71b058999e30 HTTP/1.1" status: 200 len: 1093 time: 0.7476709 Dec 08 11:34:58.822672 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'tag': '79e98205-d459-4886-827e-71b058999e30'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:34:58.824897 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3abd1843-72a0-4f76-975d-dfa6a74b9c28" -d '{"events": [{"name": "network-changed", "server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "tag": "79e98205-d459-4886-827e-71b058999e30"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:34:58.849956 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfa93d2e-2afb-44e9-99ec-d63055f06510 service neutron] Pushing event updated for resources: {'Port': ['ID=79e98205-d459-4886-827e-71b058999e30,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:34:58.860834 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:34:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eef6c0f8-e34d-4f62-9310-8a5eec104a2d x-openstack-request-id: req-eef6c0f8-e34d-4f62-9310-8a5eec104a2d {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:34:58.861137 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "tag": "79e98205-d459-4886-827e-71b058999e30", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:34:58.861465 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-eef6c0f8-e34d-4f62-9310-8a5eec104a2d {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:34:58.861980 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'tag': '79e98205-d459-4886-827e-71b058999e30', 'status': 'completed', 'code': 200} Dec 08 11:34:58.955617 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8313af92-827e-4cb1-b0ad-063052f7005e req-ee6e673a-1455-430d-80f7-87baa0715192 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:58.957738 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8313af92-827e-4cb1-b0ad-063052f7005e req-ee6e673a-1455-430d-80f7-87baa0715192 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0505879 Dec 08 11:34:59.006878 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8313af92-827e-4cb1-b0ad-063052f7005e req-fe779321-f1db-4592-ba35-03f35cc89172 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430851 Dec 08 11:34:59.598085 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94fcd04-d7d7-4073-a214-ead7f7f6ea0f req-3bd4c208-f3a8-4d58-b80f-f1b165d998c0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:59.599591 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a94fcd04-d7d7-4073-a214-ead7f7f6ea0f req-3bd4c208-f3a8-4d58-b80f-f1b165d998c0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0486097 Dec 08 11:34:59.650570 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a94fcd04-d7d7-4073-a214-ead7f7f6ea0f req-90a1212d-6823-42e3-9be8-e1bf43a567eb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450995 Dec 08 11:34:59.872305 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a310ee18-e330-406a-97b5-fe0eca64d176 req-d82b6cbb-b3e0-45f0-aff4-de4fb79800ad tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:34:59.873798 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a310ee18-e330-406a-97b5-fe0eca64d176 req-d82b6cbb-b3e0-45f0-aff4-de4fb79800ad tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0480418 Dec 08 11:34:59.926470 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a310ee18-e330-406a-97b5-fe0eca64d176 req-cad9331d-43dd-490e-824f-f5e6f05176fc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462117 Dec 08 11:35:00.123510 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672d4f5a-48c2-426e-a5ca-10d5757c432a req-89d08400-853d-4251-8367-43617f518be8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:00.124991 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-672d4f5a-48c2-426e-a5ca-10d5757c432a req-89d08400-853d-4251-8367-43617f518be8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0474315 Dec 08 11:35:00.172801 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-672d4f5a-48c2-426e-a5ca-10d5757c432a req-1c6d231e-d5ce-4a39-a98f-0b23d5af6f1f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412123 Dec 08 11:35:00.764480 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d9c230-72cc-42e8-a63d-d1bddd971b8f req-6e4332b5-575a-4ab1-bd4f-9c4d404fbe00 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:00.765983 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-25d9c230-72cc-42e8-a63d-d1bddd971b8f req-6e4332b5-575a-4ab1-bd4f-9c4d404fbe00 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0514808 Dec 08 11:35:00.821120 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-25d9c230-72cc-42e8-a63d-d1bddd971b8f req-6e9b7b43-1360-4913-86c2-2c2406aafbae tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448220 Dec 08 11:35:01.065833 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb781c30-6ed2-4aef-9379-53b5a4fceadb req-35ff1283-9702-4a3a-a049-db21f9f453b4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:01.067265 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eb781c30-6ed2-4aef-9379-53b5a4fceadb req-35ff1283-9702-4a3a-a049-db21f9f453b4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0744622 Dec 08 11:35:01.072562 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3abd1843-72a0-4f76-975d-dfa6a74b9c28 req-9e584a24-d156-4101-a70d-c1e5e9c9d02f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:01.073943 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3abd1843-72a0-4f76-975d-dfa6a74b9c28 req-9e584a24-d156-4101-a70d-c1e5e9c9d02f service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=23027f58b51142389f64405702a0fcd3&device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 1096 time: 0.0556362 Dec 08 11:35:01.117970 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eb781c30-6ed2-4aef-9379-53b5a4fceadb req-69d6c258-8dc2-4fb5-8666-b4e5716aaf11 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431006 Dec 08 11:35:01.288386 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc6d1530-9009-4895-8169-e42230feaac8 req-18a5b02e-8f0c-4ca4-8dcb-30f11b3e25b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:01.289847 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cc6d1530-9009-4895-8169-e42230feaac8 req-18a5b02e-8f0c-4ca4-8dcb-30f11b3e25b2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0472994 Dec 08 11:35:01.334617 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cc6d1530-9009-4895-8169-e42230feaac8 req-128b51a7-00bb-4cca-a5de-e80cd8b5b54f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389645 Dec 08 11:35:01.931853 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc657bfb-3d19-4841-81ca-f0d3e458f32f req-757a14bf-87a4-407e-bf9c-b52e1c034786 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:01.933228 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dc657bfb-3d19-4841-81ca-f0d3e458f32f req-757a14bf-87a4-407e-bf9c-b52e1c034786 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0470915 Dec 08 11:35:01.982061 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dc657bfb-3d19-4841-81ca-f0d3e458f32f req-703d8f15-8150-40a8-a286-a7bdf17a1469 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428727 Dec 08 11:35:02.246621 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e30746c-2ba3-4f35-9e2d-424f8f605c4c req-84d2ef7b-064d-4b3a-8c4f-7303d18bbeb7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:02.248042 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7e30746c-2ba3-4f35-9e2d-424f8f605c4c req-84d2ef7b-064d-4b3a-8c4f-7303d18bbeb7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0500655 Dec 08 11:35:02.293622 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7e30746c-2ba3-4f35-9e2d-424f8f605c4c req-6f6a6864-6554-47a6-b627-b836c657d4bb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390832 Dec 08 11:35:02.450738 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3112a68a-099a-4d82-8a03-3998e4ee3639 req-f43983f4-bbff-4dd1-8c20-aab3e5869de0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:02.452174 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3112a68a-099a-4d82-8a03-3998e4ee3639 req-f43983f4-bbff-4dd1-8c20-aab3e5869de0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0479906 Dec 08 11:35:02.497796 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3112a68a-099a-4d82-8a03-3998e4ee3639 req-fb1cc825-0d0c-4e47-afa0-bbbb3fb4b3bd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396605 Dec 08 11:35:02.688629 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3abd1843-72a0-4f76-975d-dfa6a74b9c28 req-b647e60e-f9c8-47dc-9cb4-53e994cf1598 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:02.690186 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3abd1843-72a0-4f76-975d-dfa6a74b9c28 req-b647e60e-f9c8-47dc-9cb4-53e994cf1598 service neutron] 10.222.0.61 "GET /v2.0/networks?tenant_id=23027f58b51142389f64405702a0fcd3&shared=False HTTP/1.1" status: 200 len: 910 time: 0.0905771 Dec 08 11:35:02.793533 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3abd1843-72a0-4f76-975d-dfa6a74b9c28 req-7482f367-83db-454b-9cc0-bb5efa6ce3c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:02.794997 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3abd1843-72a0-4f76-975d-dfa6a74b9c28 req-7482f367-83db-454b-9cc0-bb5efa6ce3c6 service neutron] 10.222.0.61 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0968978 Dec 08 11:35:02.875314 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-225e9bff-7b6e-425c-afe8-d34bae8eb1a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:02.876807 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-225e9bff-7b6e-425c-afe8-d34bae8eb1a6 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=23027f58b51142389f64405702a0fcd3&device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 1096 time: 0.0386107 Dec 08 11:35:02.918222 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-94879f4c-9800-4656-9a16-da6752eafbc6 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=79e98205-d459-4886-827e-71b058999e30 HTTP/1.1" status: 200 len: 217 time: 0.0331676 Dec 08 11:35:02.971266 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-f54ce29e-0c3e-435f-84e6-fd65fd8feedd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:02.972655 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-f54ce29e-0c3e-435f-84e6-fd65fd8feedd service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59081569-032b-42c0-afce-26c79ceb7aac HTTP/1.1" status: 200 len: 848 time: 0.0419540 Dec 08 11:35:03.021740 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-b252eef7-5416-4c8f-8afd-e2d01690ea65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:03.023300 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-b252eef7-5416-4c8f-8afd-e2d01690ea65 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=55a129bc-8ce3-4aac-98fb-64f16c4a4949&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0431554 Dec 08 11:35:03.157670 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b16380fe-185d-44d8-a5bc-9ef575459dae req-561788e7-5514-4d62-8e56-bf6f330dc108 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:03.159185 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b16380fe-185d-44d8-a5bc-9ef575459dae req-561788e7-5514-4d62-8e56-bf6f330dc108 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.1096098 Dec 08 11:35:03.164852 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-321caccf-d72d-4489-9070-7295d3400d1b service neutron] 10.222.0.61 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1319304 Dec 08 11:35:03.253804 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b16380fe-185d-44d8-a5bc-9ef575459dae req-67aa7255-9dd0-4532-af68-1d330545a46f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0879533 Dec 08 11:35:03.289498 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4ef3e06a-79e1-4935-a8bb-935abe7e9467 req-f7d768bd-faa6-48d6-b38d-c502549b1aff service neutron] 10.222.0.61 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1104672 Dec 08 11:35:03.420972 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f86e9a85-d960-4e91-83b3-d4599041625d req-8915a2ac-8165-46b4-a898-379d8dd66c69 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:03.422456 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f86e9a85-d960-4e91-83b3-d4599041625d req-8915a2ac-8165-46b4-a898-379d8dd66c69 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0613050 Dec 08 11:35:03.467865 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f86e9a85-d960-4e91-83b3-d4599041625d req-0c12c19e-ef95-4e7d-bc9a-c0e3e7107dcd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393701 Dec 08 11:35:03.614153 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-573acd78-3696-4139-9589-e30a9a4eb729 req-e709d3dc-2f46-4f40-a2da-e3a0f6ab23f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:03.615651 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-573acd78-3696-4139-9589-e30a9a4eb729 req-e709d3dc-2f46-4f40-a2da-e3a0f6ab23f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0468345 Dec 08 11:35:03.662612 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-573acd78-3696-4139-9589-e30a9a4eb729 req-d1f6b59c-5b0a-4b7b-ba41-4adf83ca8b18 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411615 Dec 08 11:35:04.659233 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fd41bfa-5062-433f-9a89-4f1f9285ea5d req-bc9c9ffd-25b3-411e-9944-55628b650a5a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:04.660727 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3fd41bfa-5062-433f-9a89-4f1f9285ea5d req-bc9c9ffd-25b3-411e-9944-55628b650a5a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.3407786 Dec 08 11:35:04.691273 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-2531a984-cc21-43f4-a467-24034c7a5075 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:04.692666 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-2531a984-cc21-43f4-a467-24034c7a5075 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/networks?id=6e4bda07-1ae1-4be4-bf28-e94211f51919 HTTP/1.1" status: 200 len: 813 time: 0.3708832 Dec 08 11:35:04.717302 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a53abaf1-2a24-4900-8f3f-afd2e71d3885 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/quotas/34e91fcdeaf64d10965b2770cbeab690 HTTP/1.1" status: 200 len: 375 time: 0.0183296 Dec 08 11:35:04.739538 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3fd41bfa-5062-433f-9a89-4f1f9285ea5d req-e0713975-244f-49e3-9f5f-0fb3a384fe7a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0724661 Dec 08 11:35:04.778063 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-8bd044e4-3f2d-4e4c-817a-5a0e7c1aa85a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0517716 Dec 08 11:35:04.894679 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd0675b4-6044-47c8-a3ac-b2df45f66ccb req-e47eb818-9795-40d4-816e-1f0d64c7bfea tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:04.896098 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd0675b4-6044-47c8-a3ac-b2df45f66ccb req-e47eb818-9795-40d4-816e-1f0d64c7bfea tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0939929 Dec 08 11:35:04.912482 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-47298b13-2e55-474d-bd4b-4afb65339fe6 service neutron] 10.222.0.66 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266139 Dec 08 11:35:04.991260 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd0675b4-6044-47c8-a3ac-b2df45f66ccb req-8b366522-d91e-4d25-86c3-13d5170d4867 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0882614 Dec 08 11:35:05.020418 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-e695d61c-237c-4c9c-bffb-5c32bf14696e service neutron] 10.222.0.66 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1014974 Dec 08 11:35:05.104927 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68dc5564-710b-47c2-93eb-4d99fa458b5d req-cb9baf3d-b4df-41f6-b0d9-d317e38a7eb0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:05.112957 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-68dc5564-710b-47c2-93eb-4d99fa458b5d req-cb9baf3d-b4df-41f6-b0d9-d317e38a7eb0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0574076 Dec 08 11:35:05.180178 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-68dc5564-710b-47c2-93eb-4d99fa458b5d req-797548fa-39e0-4198-90eb-fc269bea76be tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0663223 Dec 08 11:35:05.194692 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-91be3833-3539-404d-8aa8-66681a8a17e0 req-f603129a-4bdc-49e7-b5c1-4082ca582c03 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 210 time: 0.0368972 Dec 08 11:35:05.849935 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-406feaa3-c36c-47fb-a39b-b8b9ee5fe8fa req-2ea51d8f-bf3b-4d8e-a939-92a75f1f9232 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:05.851404 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-406feaa3-c36c-47fb-a39b-b8b9ee5fe8fa req-2ea51d8f-bf3b-4d8e-a939-92a75f1f9232 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0476866 Dec 08 11:35:05.900931 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-406feaa3-c36c-47fb-a39b-b8b9ee5fe8fa req-ef4464a0-2425-46ec-ada4-b3955ed3e4dd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435450 Dec 08 11:35:06.104653 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b96499-9425-4ee1-84fb-bf778504b34e req-80766496-096f-4a78-b004-e8c405db1301 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:06.106182 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-53b96499-9425-4ee1-84fb-bf778504b34e req-80766496-096f-4a78-b004-e8c405db1301 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0477257 Dec 08 11:35:06.156517 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-53b96499-9425-4ee1-84fb-bf778504b34e req-ffc77acb-7fc1-47f4-a756-1d8b08f18bb4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436532 Dec 08 11:35:06.302992 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-532f4cb8-1042-4424-a7d4-7a83178949b4 req-6abb7ab2-89ae-4846-bbaa-31af930dbd2a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 210 time: 0.0382409 Dec 08 11:35:06.321653 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c343f114-e32e-4089-863b-6251e97fda44 req-21061046-59f0-4659-8da1-6f48b1136a98 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:06.323069 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c343f114-e32e-4089-863b-6251e97fda44 req-21061046-59f0-4659-8da1-6f48b1136a98 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0670733 Dec 08 11:35:06.369994 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c343f114-e32e-4089-863b-6251e97fda44 req-a00d5d18-b210-4c21-b687-cffb1bdef444 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406933 Dec 08 11:35:07.014294 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967aa6af-abc2-4d09-94df-d502589245ce req-478047ce-7f18-48b4-881b-5d8f47cb3599 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:07.015749 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-967aa6af-abc2-4d09-94df-d502589245ce req-478047ce-7f18-48b4-881b-5d8f47cb3599 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0512919 Dec 08 11:35:07.064342 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-967aa6af-abc2-4d09-94df-d502589245ce req-b11afdda-e08f-4b15-b921-cd7523bc59aa tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418005 Dec 08 11:35:07.268177 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d76b166f-3bb2-4999-a6f7-40778e1f6eb0 req-f71d0d6f-f285-4b0b-80ca-6c12f5b99239 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:07.270227 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d76b166f-3bb2-4999-a6f7-40778e1f6eb0 req-f71d0d6f-f285-4b0b-80ca-6c12f5b99239 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0475440 Dec 08 11:35:07.314609 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d76b166f-3bb2-4999-a6f7-40778e1f6eb0 req-1b7488c8-e74b-49ca-9097-d00f65770eb0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385160 Dec 08 11:35:07.392292 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1a8f8913-968a-4a75-a568-aea4f931ee88 req-fea31d60-61d3-4ab6-b261-2eb548c8995a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 210 time: 0.0255044 Dec 08 11:35:07.490538 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a63de1c4-3dae-45fc-803a-fc9f25211309 req-ed704cb0-a508-412d-a3f0-3c552f39c3d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:07.492942 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a63de1c4-3dae-45fc-803a-fc9f25211309 req-ed704cb0-a508-412d-a3f0-3c552f39c3d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0545228 Dec 08 11:35:07.539049 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a63de1c4-3dae-45fc-803a-fc9f25211309 req-3288132e-aef9-429c-bc49-3208aebffce0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404599 Dec 08 11:35:08.177097 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40b4edb4-102d-4dd4-9aff-7803e8d2f61d req-be5941f4-1347-4d34-a6cc-5753cf80996c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:08.178577 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-40b4edb4-102d-4dd4-9aff-7803e8d2f61d req-be5941f4-1347-4d34-a6cc-5753cf80996c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0486431 Dec 08 11:35:08.226339 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-40b4edb4-102d-4dd4-9aff-7803e8d2f61d req-da12d3dd-fbbc-4a9b-8d2b-5eeb00d30064 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417912 Dec 08 11:35:08.428735 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54c4993e-b911-4593-965e-0ee8a7dd984a req-3a58be48-6ea6-4991-9333-6fcd3297e70d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:08.430252 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-54c4993e-b911-4593-965e-0ee8a7dd984a req-3a58be48-6ea6-4991-9333-6fcd3297e70d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0487115 Dec 08 11:35:08.494888 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7edc86a8-81d0-4f37-a41c-d43b027bc29c req-c1f4b85d-a553-44d4-a4e9-eda245cb6e98 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 210 time: 0.0393460 Dec 08 11:35:08.501851 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-54c4993e-b911-4593-965e-0ee8a7dd984a req-aeb9a806-f13d-4d87-8bfb-cf469460c88f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0658400 Dec 08 11:35:08.654795 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a3faaf6-5044-474b-ae2b-5e7908439a41 req-da512342-ad8c-4427-b932-b6b36bc7c2b5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:08.656233 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9a3faaf6-5044-474b-ae2b-5e7908439a41 req-da512342-ad8c-4427-b932-b6b36bc7c2b5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0473721 Dec 08 11:35:08.702297 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9a3faaf6-5044-474b-ae2b-5e7908439a41 req-c7977c9d-1211-4832-aadc-823253f253d2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397201 Dec 08 11:35:09.337634 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5602496b-5c3e-4119-ad19-8757112549dc req-8a9b9def-2f40-4d43-9d1d-0251da3a5caa tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:09.339091 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5602496b-5c3e-4119-ad19-8757112549dc req-8a9b9def-2f40-4d43-9d1d-0251da3a5caa tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0477076 Dec 08 11:35:09.390201 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5602496b-5c3e-4119-ad19-8757112549dc req-0304e46b-c23c-418a-8df9-23640c66ac59 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453124 Dec 08 11:35:09.593853 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5a60cff2-bf38-4340-b610-0c5ed53fa385 req-7f09ff4d-6221-4291-aab2-42cce33964d2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 210 time: 0.0339544 Dec 08 11:35:09.634596 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94c3df59-1840-4946-a873-75b8645977e6 req-b1b95cc3-3d7d-4aed-bf03-58a8a18b3511 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:09.636226 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-94c3df59-1840-4946-a873-75b8645977e6 req-b1b95cc3-3d7d-4aed-bf03-58a8a18b3511 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0670202 Dec 08 11:35:09.687339 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-94c3df59-1840-4946-a873-75b8645977e6 req-b00269c3-c2ae-4a9a-8268-e63608b19eb0 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447376 Dec 08 11:35:09.822936 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-913e79bd-0801-4d4a-9931-a8d38c0bc820 req-d20096ef-7ad9-4631-9441-e20fc47a8329 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:09.824840 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-913e79bd-0801-4d4a-9931-a8d38c0bc820 req-d20096ef-7ad9-4631-9441-e20fc47a8329 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0503681 Dec 08 11:35:09.880307 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-913e79bd-0801-4d4a-9931-a8d38c0bc820 req-13b126bc-6fd5-4cb0-8637-57c2b09e99e9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493712 Dec 08 11:35:10.516292 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-983d52e3-1373-4a76-9e5e-754d2769f47d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:10.518047 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-983d52e3-1373-4a76-9e5e-754d2769f47d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "GET /v2.0/networks?id=6e4bda07-1ae1-4be4-bf28-e94211f51919 HTTP/1.1" status: 200 len: 813 time: 0.1364853 Dec 08 11:35:10.533747 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f1b3c58-5559-498f-b407-92bce997bb87 req-3e68d057-2e23-4db3-b263-7e5d8dc4b79a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:10.535793 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5f1b3c58-5559-498f-b407-92bce997bb87 req-3e68d057-2e23-4db3-b263-7e5d8dc4b79a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0730252 Dec 08 11:35:10.540693 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-f8030763-b592-4794-bfbe-df7ec8310709 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Request body: {'port': {'device_id': '16a3dc0f-c35b-4f26-b4da-455158247814', 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919', 'admin_state_up': True, 'tenant_id': '34e91fcdeaf64d10965b2770cbeab690'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:35:10.650164 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5f1b3c58-5559-498f-b407-92bce997bb87 req-c0b9cd14-1756-482b-8130-faf3376fd86b tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1060350 Dec 08 11:35:10.704716 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3e8d245c-d746-4769-b77b-834dd910b675 req-d014d20f-e14e-48da-bf72-a093b3432d8b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 210 time: 0.0287626 Dec 08 11:35:10.714348 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-f8030763-b592-4794-bfbe-df7ec8310709 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Made reservation on behalf of 34e91fcdeaf64d10965b2770cbeab690 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:35:10.718788 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-f8030763-b592-4794-bfbe-df7ec8310709 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:10.863482 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a35a6b5-ae67-4649-90e1-aa02ee54c7ab req-99784e5d-7f69-4fe8-a266-2f9e663f0e5b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:10.864950 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1a35a6b5-ae67-4649-90e1-aa02ee54c7ab req-99784e5d-7f69-4fe8-a266-2f9e663f0e5b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0903549 Dec 08 11:35:10.894169 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-f8030763-b592-4794-bfbe-df7ec8310709 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Allocated IP 172.20.0.7 (6e4bda07-1ae1-4be4-bf28-e94211f51919/d6b1fb0e-d38f-47ca-a647-53b824c47e76/222531bb-d35b-49bb-b52a-9b0f529866e2) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:35:10.945781 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1a35a6b5-ae67-4649-90e1-aa02ee54c7ab req-1a381de1-07f1-4f7f-a547-5021562ae8a9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0744839 Dec 08 11:35:11.055729 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1402e62-0129-4cf4-af0d-a68f100b9cf2 req-5cd53045-0cfa-4e01-bde6-da20a2c8efc2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:11.057239 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e1402e62-0129-4cf4-af0d-a68f100b9cf2 req-5cd53045-0cfa-4e01-bde6-da20a2c8efc2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.1001406 Dec 08 11:35:11.145282 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-f8030763-b592-4794-bfbe-df7ec8310709 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:11.208273 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e1402e62-0129-4cf4-af0d-a68f100b9cf2 req-b1951b3f-e812-4fcb-ab65-3afd05b961b6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1428070 Dec 08 11:35:11.249424 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac78be79-0fcb-42a7-98d8-48fc95e41b0f req-abdcf666-e2e8-47fa-b678-72328522e02a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:11.251715 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ac78be79-0fcb-42a7-98d8-48fc95e41b0f req-abdcf666-e2e8-47fa-b678-72328522e02a tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0943553 Dec 08 11:35:11.293070 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-f8030763-b592-4794-bfbe-df7ec8310709 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:11.321383 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['d9ecab87-157e-4ccb-8423-2248bb8451ea', '1d5f08a0-9b25-48d8-a2ed-88647aec1670', 'be511646-f492-43f2-af08-bc641afcd8a2'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:35:11.368235 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-f8030763-b592-4794-bfbe-df7ec8310709 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Network 6e4bda07-1ae1-4be4-bf28-e94211f51919 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:35:11.384711 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-f8030763-b592-4794-bfbe-df7ec8310709 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:35:11.391031 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8edb994d-e59c-418f-8b7a-bb0e29069374 req-613da709-5c6c-49cc-957d-43ae8e1fd0a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:11.391995 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8edb994d-e59c-418f-8b7a-bb0e29069374 req-613da709-5c6c-49cc-957d-43ae8e1fd0a8 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=9c60094b48d34489b46e92ae73d7e33a&device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 1098 time: 0.1400378 Dec 08 11:35:11.395775 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-f8030763-b592-4794-bfbe-df7ec8310709 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:35:11.402704 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ac78be79-0fcb-42a7-98d8-48fc95e41b0f req-75277476-f56c-4e2d-aa2c-4ed3d613cbdc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1396201 Dec 08 11:35:11.422620 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8030763-b592-4794-bfbe-df7ec8310709 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Pushing event updated for resources: {'Port': ['ID=222531bb-d35b-49bb-b52a-9b0f529866e2,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:11.496142 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-f8030763-b592-4794-bfbe-df7ec8310709 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:11.496668 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-f8030763-b592-4794-bfbe-df7ec8310709 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:11.523337 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-f8030763-b592-4794-bfbe-df7ec8310709 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9865339 Dec 08 11:35:11.539527 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8edb994d-e59c-418f-8b7a-bb0e29069374 req-62096d3d-c9ae-4ff3-aabe-99df2ca1b43a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:11.541007 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8edb994d-e59c-418f-8b7a-bb0e29069374 req-62096d3d-c9ae-4ff3-aabe-99df2ca1b43a service neutron] 10.222.0.61 "GET /v2.0/networks?id=185aeb08-41ef-4fae-a420-33296f710850 HTTP/1.1" status: 200 len: 911 time: 0.1374123 Dec 08 11:35:11.573402 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Request body: {'port': {'device_id': '16a3dc0f-c35b-4f26-b4da-455158247814', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:35:11.677545 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8edb994d-e59c-418f-8b7a-bb0e29069374 req-c755c6dd-6132-414f-85f7-75271ea0c961 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=731fa8a4-e27d-4561-a86e-aa21c87548e7 HTTP/1.1" status: 200 len: 1001 time: 0.1014740 Dec 08 11:35:11.678396 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:11.860724 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73002510-c452-4749-bea9-f1aa0ad92a85 req-022ce236-8134-4f2a-a299-20b99363c1f3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:11.862804 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-73002510-c452-4749-bea9-f1aa0ad92a85 req-022ce236-8134-4f2a-a299-20b99363c1f3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.1449008 Dec 08 11:35:11.937054 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6691bd37-df18-4230-9771-30987c829f8f req-2888aa44-3eb8-4685-a2ff-59a1693a9a19 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:11.938526 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6691bd37-df18-4230-9771-30987c829f8f req-2888aa44-3eb8-4685-a2ff-59a1693a9a19 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 931 time: 0.1359303 Dec 08 11:35:12.000926 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-73002510-c452-4749-bea9-f1aa0ad92a85 req-925886c0-a169-4b6e-b061-26902e55d90e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1221879 Dec 08 11:35:12.049053 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6691bd37-df18-4230-9771-30987c829f8f req-d1da7759-d747-45c5-925d-131f829d10f2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1027944 Dec 08 11:35:12.088891 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 222531bb-d35b-49bb-b52a-9b0f529866e2 {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:35:12.097160 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:12.109236 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Transition to ACTIVE for port object 222531bb-d35b-49bb-b52a-9b0f529866e2 will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:35:12.113006 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:12.166476 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Pushing event updated for resources: {'Port': ['ID=222531bb-d35b-49bb-b52a-9b0f529866e2,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:12.233268 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Attempting to bind port 222531bb-d35b-49bb-b52a-9b0f529866e2 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:35:12.233481 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Attempting to bind port 222531bb-d35b-49bb-b52a-9b0f529866e2 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:35:12.233813 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Attempting to bind port 222531bb-d35b-49bb-b52a-9b0f529866e2 on network 6e4bda07-1ae1-4be4-bf28-e94211f51919 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:35:12.238150 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Port 222531bb-d35b-49bb-b52a-9b0f529866e2 on network 6e4bda07-1ae1-4be4-bf28-e94211f51919 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:35:12.238475 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Attempting to bind port 222531bb-d35b-49bb-b52a-9b0f529866e2 on network 6e4bda07-1ae1-4be4-bf28-e94211f51919 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:35:12.243353 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 34, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:35:12.243695 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Checking segment: {'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:35:12.244076 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Bound using segment: {'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:35:12.244507 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Bound port: 222531bb-d35b-49bb-b52a-9b0f529866e2, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6591c62b-7ba0-41ad-8d14-59c272604f28', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 277, 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:35:12.244861 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:12.332329 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] For port 222531bb-d35b-49bb-b52a-9b0f529866e2, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:35:12.335946 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] For port 222531bb-d35b-49bb-b52a-9b0f529866e2, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=222531bb-d35b-49bb-b52a-9b0f529866e2,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:35:12.343595 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:12.358522 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b38ae1b-b2f1-437b-831a-be847778222e req-f2081ea3-a29b-4ba2-83a1-8f2ab925c803 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:12.359979 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7b38ae1b-b2f1-437b-831a-be847778222e req-f2081ea3-a29b-4ba2-83a1-8f2ab925c803 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0718362 Dec 08 11:35:12.391560 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:12.392155 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:12.394354 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] 10.222.0.61 "PUT /v2.0/ports/222531bb-d35b-49bb-b52a-9b0f529866e2 HTTP/1.1" status: 200 len: 1093 time: 0.8250928 Dec 08 11:35:12.396185 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16a3dc0f-c35b-4f26-b4da-455158247814', 'tag': '222531bb-d35b-49bb-b52a-9b0f529866e2'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:35:12.398385 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e9e68643-6e53-45a6-8f1c-4a5c0e5400de" -d '{"events": [{"name": "network-changed", "server_uuid": "16a3dc0f-c35b-4f26-b4da-455158247814", "tag": "222531bb-d35b-49bb-b52a-9b0f529866e2"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:35:12.442474 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:35:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82038d71-2ab5-4cd6-abb5-92e95f5d1303 x-openstack-request-id: req-82038d71-2ab5-4cd6-abb5-92e95f5d1303 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:35:12.442766 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16a3dc0f-c35b-4f26-b4da-455158247814", "tag": "222531bb-d35b-49bb-b52a-9b0f529866e2", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:35:12.443018 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-82038d71-2ab5-4cd6-abb5-92e95f5d1303 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:35:12.443409 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16a3dc0f-c35b-4f26-b4da-455158247814', 'tag': '222531bb-d35b-49bb-b52a-9b0f529866e2', 'status': 'completed', 'code': 200} Dec 08 11:35:12.447992 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a73d9776-14ff-4a90-a656-f2e7dafced60 service neutron] Pushing event updated for resources: {'Port': ['ID=222531bb-d35b-49bb-b52a-9b0f529866e2,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:12.457930 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7b38ae1b-b2f1-437b-831a-be847778222e req-03ce3b5a-c48c-42c0-8fd9-6e0cdcc70e52 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0798669 Dec 08 11:35:12.531181 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1629e93e-0961-4263-b55f-bdb1c894b007 req-b1d1c1c6-4587-4687-8432-c069db500990 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:12.532546 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1629e93e-0961-4263-b55f-bdb1c894b007 req-b1d1c1c6-4587-4687-8432-c069db500990 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0485346 Dec 08 11:35:12.579145 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1629e93e-0961-4263-b55f-bdb1c894b007 req-dc7827e3-ef45-4b77-bfea-1fb0cd77c5cb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402558 Dec 08 11:35:13.118313 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4cc55ab-0d0f-4502-adb7-27b0d43a9451 req-edff28e8-e415-4be8-8fcf-bd958ac357d6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:13.119798 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a4cc55ab-0d0f-4502-adb7-27b0d43a9451 req-edff28e8-e415-4be8-8fcf-bd958ac357d6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0528488 Dec 08 11:35:13.199167 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11101ae8-78d2-4023-8421-6e625cf1f681 req-719eb7d2-e532-4cdd-ad8b-9fd585153eb2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:13.200666 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-11101ae8-78d2-4023-8421-6e625cf1f681 req-719eb7d2-e532-4cdd-ad8b-9fd585153eb2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 943 time: 0.0799952 Dec 08 11:35:13.205475 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a4cc55ab-0d0f-4502-adb7-27b0d43a9451 req-06677779-3a41-4f00-99f9-33b4c495ab68 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0767474 Dec 08 11:35:13.248122 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-11101ae8-78d2-4023-8421-6e625cf1f681 req-b2ebb7dc-e7a1-4cbf-a7b2-174b66bbd5c4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414610 Dec 08 11:35:13.575166 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f7b02f0-b3f5-4c3b-a257-02759bb88caa req-03eef7c3-ecb0-467a-b764-e6c698a3294e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:13.576674 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4f7b02f0-b3f5-4c3b-a257-02759bb88caa req-03eef7c3-ecb0-467a-b764-e6c698a3294e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0485132 Dec 08 11:35:13.624773 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4f7b02f0-b3f5-4c3b-a257-02759bb88caa req-f99c4451-945b-44d9-b66e-96cff7b85cb6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417945 Dec 08 11:35:13.696680 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca92d739-2268-4764-b73c-ccac8b4cbe3e req-712f0d5b-45bc-47b0-b903-39c66ece29ec tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:13.698143 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ca92d739-2268-4764-b73c-ccac8b4cbe3e req-712f0d5b-45bc-47b0-b903-39c66ece29ec tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0472333 Dec 08 11:35:13.746493 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ca92d739-2268-4764-b73c-ccac8b4cbe3e req-62107966-fee3-4ac4-9388-e2fb5f08c290 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426395 Dec 08 11:35:14.321567 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-363dfdcf-a966-49af-ab40-705e1256b206 req-39b9a24c-78fc-4c88-ad51-3d7023c064fb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:14.323025 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-363dfdcf-a966-49af-ab40-705e1256b206 req-39b9a24c-78fc-4c88-ad51-3d7023c064fb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0504680 Dec 08 11:35:14.395510 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-363dfdcf-a966-49af-ab40-705e1256b206 req-f0b84e82-1a93-474c-ad32-e9a3d066ab9e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0631843 Dec 08 11:35:14.403718 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5537dc68-0dbe-4a90-9db4-0ddd3900ecfc req-d9625865-2f7b-4972-92e1-774950b0c8e6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:14.405127 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5537dc68-0dbe-4a90-9db4-0ddd3900ecfc req-d9625865-2f7b-4972-92e1-774950b0c8e6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 943 time: 0.0812557 Dec 08 11:35:14.450985 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5537dc68-0dbe-4a90-9db4-0ddd3900ecfc req-390aa7f2-121b-4c47-9b0c-a766771e9cc2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392044 Dec 08 11:35:14.742346 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06101e01-2070-48b0-b6e6-58584a0ac645 req-d21a6498-a766-4ca9-81e3-0056459af4d5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:14.743783 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-06101e01-2070-48b0-b6e6-58584a0ac645 req-d21a6498-a766-4ca9-81e3-0056459af4d5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0496616 Dec 08 11:35:14.791777 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-06101e01-2070-48b0-b6e6-58584a0ac645 req-8bc18d5a-e61d-4076-b1d3-caa23825450a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421119 Dec 08 11:35:14.859199 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf42699e-1eb9-4665-be33-721058eae5d0 req-ef0c6379-73f7-4b5f-89d2-c1a039c3e552 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:14.860667 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf42699e-1eb9-4665-be33-721058eae5d0 req-ef0c6379-73f7-4b5f-89d2-c1a039c3e552 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0477040 Dec 08 11:35:14.906657 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf42699e-1eb9-4665-be33-721058eae5d0 req-ed6d3a23-bc4b-43f6-b43c-f1f2b3d95ffe tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401192 Dec 08 11:35:15.511846 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76738d69-8fdb-4845-bad9-438387faf89a req-d8e716da-f2e0-4f5b-9bf2-e8989141ad48 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:15.513439 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-76738d69-8fdb-4845-bad9-438387faf89a req-d8e716da-f2e0-4f5b-9bf2-e8989141ad48 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0509555 Dec 08 11:35:15.587045 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbb8fb3a-bbfc-4bdd-8984-96a06febbfc2 req-a6054f9d-1886-46e6-bf66-d52c73ac9de4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:15.588480 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbb8fb3a-bbfc-4bdd-8984-96a06febbfc2 req-a6054f9d-1886-46e6-bf66-d52c73ac9de4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 943 time: 0.0704975 Dec 08 11:35:15.614892 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-76738d69-8fdb-4845-bad9-438387faf89a req-75db1a1b-f223-4a66-8280-047131d46141 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0710568 Dec 08 11:35:15.643156 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbb8fb3a-bbfc-4bdd-8984-96a06febbfc2 req-9a1460a2-75a1-4554-837a-ff37e0f590d6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471580 Dec 08 11:35:15.910334 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6b9e1b3-79c6-466a-a01a-ba44d32046a3 req-89543b10-7961-4e16-b192-be7c70211113 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:15.911687 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f6b9e1b3-79c6-466a-a01a-ba44d32046a3 req-89543b10-7961-4e16-b192-be7c70211113 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0474324 Dec 08 11:35:15.961254 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f6b9e1b3-79c6-466a-a01a-ba44d32046a3 req-030eba70-694e-43fd-993a-43c397141210 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436189 Dec 08 11:35:16.020274 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06de6f46-0b5f-4bf1-94ce-527f93353441 req-ad29e62c-6e9e-4237-971c-9dc0e3a1ad9e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:16.021753 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-06de6f46-0b5f-4bf1-94ce-527f93353441 req-ad29e62c-6e9e-4237-971c-9dc0e3a1ad9e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0492029 Dec 08 11:35:16.067816 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-06de6f46-0b5f-4bf1-94ce-527f93353441 req-3aaa4e92-66b3-4cac-8eb8-99ef0f231f3f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399785 Dec 08 11:35:16.756640 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14549a9e-8010-41bc-8be2-f89d18346a8a req-5ae119fb-80d7-4c81-b4c5-1621d87b7924 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:16.758197 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-14549a9e-8010-41bc-8be2-f89d18346a8a req-5ae119fb-80d7-4c81-b4c5-1621d87b7924 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0766461 Dec 08 11:35:16.782616 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24ebcbf7-e9b2-41b1-984d-9a22637c98b6 req-3e8363c5-9cdc-463b-bc7a-20d0f3a6463b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:16.784038 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-24ebcbf7-e9b2-41b1-984d-9a22637c98b6 req-3e8363c5-9cdc-463b-bc7a-20d0f3a6463b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 943 time: 0.0733969 Dec 08 11:35:16.894106 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-14549a9e-8010-41bc-8be2-f89d18346a8a req-a2779a2f-5506-43bd-9bd8-6336eb9b3428 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1236057 Dec 08 11:35:16.932073 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-24ebcbf7-e9b2-41b1-984d-9a22637c98b6 req-95039c0c-3065-4478-9a69-543090f549d2 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1408403 Dec 08 11:35:16.935988 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8edb994d-e59c-418f-8b7a-bb0e29069374 req-5fbe2ea9-40a3-4a4d-979b-12fc222f026e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:16.937392 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8edb994d-e59c-418f-8b7a-bb0e29069374 req-5fbe2ea9-40a3-4a4d-979b-12fc222f026e service neutron] 10.222.0.61 "GET /v2.0/subnets?id=40a584f7-ce77-4d89-87c2-4f3f589c6700 HTTP/1.1" status: 200 len: 849 time: 0.1201074 Dec 08 11:35:16.972086 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e68643-6e53-45a6-8f1c-4a5c0e5400de req-0cce5232-d51b-4fbf-ba8e-a727028c4673 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:16.973552 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e9e68643-6e53-45a6-8f1c-4a5c0e5400de req-0cce5232-d51b-4fbf-ba8e-a727028c4673 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 1096 time: 0.1451526 Dec 08 11:35:17.088530 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6c4d6c67-c31a-4f81-a111-948ec1e94257 req-a468a3fe-d739-4077-bd08-bd8cb545ff77 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1692319 Dec 08 11:35:17.097259 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8edb994d-e59c-418f-8b7a-bb0e29069374 req-29ae5985-6afe-4e2d-b271-ecb898653df8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:17.098729 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8edb994d-e59c-418f-8b7a-bb0e29069374 req-29ae5985-6afe-4e2d-b271-ecb898653df8 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=185aeb08-41ef-4fae-a420-33296f710850&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1429915 Dec 08 11:35:17.195340 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e68643-6e53-45a6-8f1c-4a5c0e5400de req-e0cfd988-6f16-4db0-97a8-0fd6a68eeac2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:17.196782 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e9e68643-6e53-45a6-8f1c-4a5c0e5400de req-e0cfd988-6f16-4db0-97a8-0fd6a68eeac2 service neutron] 10.222.0.61 "GET /v2.0/networks?tenant_id=34e91fcdeaf64d10965b2770cbeab690&shared=False HTTP/1.1" status: 200 len: 914 time: 0.2092714 Dec 08 11:35:17.490081 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe0e52b-84ae-4df8-a499-8bb420677efa req-542a2ca8-c6d7-4878-bda6-0ef8276e5c9e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:17.491535 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dbe0e52b-84ae-4df8-a499-8bb420677efa req-542a2ca8-c6d7-4878-bda6-0ef8276e5c9e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.4501696 Dec 08 11:35:17.552121 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:17.618890 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe8cda6-91b4-4530-930b-40a3334f705e req-d945f6b0-50aa-497b-9f27-f31442239e46 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:17.620373 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2fe8cda6-91b4-4530-930b-40a3334f705e req-d945f6b0-50aa-497b-9f27-f31442239e46 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.4506495 Dec 08 11:35:17.621979 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4d6c67-c31a-4f81-a111-948ec1e94257 req-c7ee6824-f691-4d9d-b53e-eb115acc295f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:17.623312 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6c4d6c67-c31a-4f81-a111-948ec1e94257 req-c7ee6824-f691-4d9d-b53e-eb115acc295f service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 1099 time: 0.4547353 Dec 08 11:35:17.632423 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8edb994d-e59c-418f-8b7a-bb0e29069374 req-7bbae0af-6694-4f8a-a7d7-87fbe544e001 service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5228345 Dec 08 11:35:17.701453 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dbe0e52b-84ae-4df8-a499-8bb420677efa req-c597f3d6-f536-47a0-b2d2-68b7f0971f65 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1925206 Dec 08 11:35:17.781951 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e68643-6e53-45a6-8f1c-4a5c0e5400de req-9d8b466e-3279-4b79-a8e2-e38c425f3b24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:17.784483 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e9e68643-6e53-45a6-8f1c-4a5c0e5400de req-9d8b466e-3279-4b79-a8e2-e38c425f3b24 service neutron] 10.222.0.61 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3171737 Dec 08 11:35:17.832194 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2fe8cda6-91b4-4530-930b-40a3334f705e req-d9f12055-8516-4559-a269-3543482d2712 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2019889 Dec 08 11:35:17.927190 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4d6c67-c31a-4f81-a111-948ec1e94257 req-3fba68b6-d648-4fcb-80dc-a889ceeead24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:17.929026 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6c4d6c67-c31a-4f81-a111-948ec1e94257 req-3fba68b6-d648-4fcb-80dc-a889ceeead24 service neutron] 10.222.0.61 "GET /v2.0/networks?id=6e4bda07-1ae1-4be4-bf28-e94211f51919 HTTP/1.1" status: 200 len: 914 time: 0.2562213 Dec 08 11:35:17.933714 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8edb994d-e59c-418f-8b7a-bb0e29069374 req-8a4b9ec5-fd51-41bb-ac9a-e6df6a61560d service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2738020 Dec 08 11:35:17.944920 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-eba14333-d342-4773-a061-200425d29758 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:17.947001 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-eba14333-d342-4773-a061-200425d29758 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=34e91fcdeaf64d10965b2770cbeab690&device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 1096 time: 0.1101635 Dec 08 11:35:18.063532 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6c4d6c67-c31a-4f81-a111-948ec1e94257 req-ede75b81-ad97-4c53-85b2-e5a86a5938d0 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d9ecab87-157e-4ccb-8423-2248bb8451ea HTTP/1.1" status: 200 len: 217 time: 0.0993106 Dec 08 11:35:18.108043 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-748577b2-70bf-4622-8cee-fe3e6b49e890 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=222531bb-d35b-49bb-b52a-9b0f529866e2 HTTP/1.1" status: 200 len: 217 time: 0.1323948 Dec 08 11:35:18.227712 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c4d6c67-c31a-4f81-a111-948ec1e94257 req-857eb796-38c2-48cf-ba95-1f532e84e308 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:18.229257 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6c4d6c67-c31a-4f81-a111-948ec1e94257 req-857eb796-38c2-48cf-ba95-1f532e84e308 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=d6b1fb0e-d38f-47ca-a647-53b824c47e76 HTTP/1.1" status: 200 len: 853 time: 0.1500514 Dec 08 11:35:18.236500 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c5fc40e-2fba-4bdc-9e7f-e5d6689480b6 req-da2cb9a0-4dca-4ae6-91b8-9caba430d8d3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:18.238419 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6c5fc40e-2fba-4bdc-9e7f-e5d6689480b6 req-da2cb9a0-4dca-4ae6-91b8-9caba430d8d3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.2569416 Dec 08 11:35:18.257443 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7748ebc9-410c-4e0c-a2bd-df9131a88dba req-918ca769-498c-49c6-8bb0-f74015d97aae tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:18.258907 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7748ebc9-410c-4e0c-a2bd-df9131a88dba req-918ca769-498c-49c6-8bb0-f74015d97aae tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.2873783 Dec 08 11:35:18.268841 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c677ee78-f617-4a45-bf99-82dcf405e36a req-c86a37e0-9b5d-4663-a14d-28fcab9916fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:18.270615 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c677ee78-f617-4a45-bf99-82dcf405e36a req-c86a37e0-9b5d-4663-a14d-28fcab9916fb service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=801ccccb4d7647de8e9558e07ebdc070&device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 1098 time: 0.2519174 Dec 08 11:35:18.287859 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-fbad4ff1-10ef-479c-9add-b8eed63679a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:18.289267 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-fbad4ff1-10ef-479c-9add-b8eed63679a7 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=d6b1fb0e-d38f-47ca-a647-53b824c47e76 HTTP/1.1" status: 200 len: 853 time: 0.1480682 Dec 08 11:35:18.302163 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6c4d6c67-c31a-4f81-a111-948ec1e94257 req-a6697cb1-fcbd-47e7-8654-3f16b392d342 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=6e4bda07-1ae1-4be4-bf28-e94211f51919&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0617552 Dec 08 11:35:18.388822 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-92cdced4-d4cd-4bb3-a4e5-b9a08de6b843 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=6e4bda07-1ae1-4be4-bf28-e94211f51919&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0799284 Dec 08 11:35:18.538514 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6c5fc40e-2fba-4bdc-9e7f-e5d6689480b6 req-6aa4a566-bf45-4ae7-af50-b70e627f69bf tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2772923 Dec 08 11:35:18.554536 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7748ebc9-410c-4e0c-a2bd-df9131a88dba req-f28f51c9-ad28-4ec2-a780-7eb66efab85c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2829750 Dec 08 11:35:18.601921 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c677ee78-f617-4a45-bf99-82dcf405e36a req-7b05d32e-9a70-40d2-81ed-44bd0a5c5f0a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:18.603402 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c677ee78-f617-4a45-bf99-82dcf405e36a req-7b05d32e-9a70-40d2-81ed-44bd0a5c5f0a service neutron] 10.222.0.61 "GET /v2.0/networks?id=b799b290-99c1-4693-82cc-42bbd4d90adb HTTP/1.1" status: 200 len: 920 time: 0.3082652 Dec 08 11:35:18.616798 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6c4d6c67-c31a-4f81-a111-948ec1e94257 req-dc8f5967-c129-4482-9398-b923d6b8f40f service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2802038 Dec 08 11:35:18.704483 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c677ee78-f617-4a45-bf99-82dcf405e36a req-7fe048af-1a4e-444a-94d6-17ad38856174 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=96b6dc81-7654-48f5-ac3f-e3e4d35982b3 HTTP/1.1" status: 200 len: 217 time: 0.0866754 Dec 08 11:35:18.729478 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-00bd3c49-3587-48b8-a07c-bb587d872d37 service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2964504 Dec 08 11:35:18.861221 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a066a08d-eab7-4cf5-960c-cd2817146fdf req-cfbcfb6d-80db-4adc-90e3-ac5898f86b3b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:18.862767 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a066a08d-eab7-4cf5-960c-cd2817146fdf req-cfbcfb6d-80db-4adc-90e3-ac5898f86b3b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 943 time: 0.2517912 Dec 08 11:35:18.901139 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c677ee78-f617-4a45-bf99-82dcf405e36a req-7b2591c4-0fff-42c5-b2af-b3a85d2a5eb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:18.902777 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c677ee78-f617-4a45-bf99-82dcf405e36a req-7b2591c4-0fff-42c5-b2af-b3a85d2a5eb8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59ab11c2-3db5-4069-afa6-b6f825d69316 HTTP/1.1" status: 200 len: 859 time: 0.1724350 Dec 08 11:35:18.981044 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6c4d6c67-c31a-4f81-a111-948ec1e94257 req-57a2b873-af82-4ca1-b844-787a732da03b service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3331096 Dec 08 11:35:18.982660 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c677ee78-f617-4a45-bf99-82dcf405e36a req-4e78e39d-be62-4303-941d-154e879ec24c service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b799b290-99c1-4693-82cc-42bbd4d90adb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0545802 Dec 08 11:35:18.994679 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09527e90-403e-4fc2-a8a4-84fbf71bc80b req-78416012-be70-4f38-85f1-b0cf78410144 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:18.996106 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-09527e90-403e-4fc2-a8a4-84fbf71bc80b req-78416012-be70-4f38-85f1-b0cf78410144 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.2187836 Dec 08 11:35:19.072193 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-377e9f61-b945-42b5-8ea1-850c28a2e443 req-f13f4ba5-bad6-45ea-ac45-c3d883b3c7e4 service neutron] 10.222.0.61 "GET /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3308582 Dec 08 11:35:19.075517 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a066a08d-eab7-4cf5-960c-cd2817146fdf req-7eb2db42-a2ff-42de-8293-0a0af7daeb10 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1968486 Dec 08 11:35:19.127043 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-09527e90-403e-4fc2-a8a4-84fbf71bc80b req-40622290-c6e1-46f9-80e0-0c3346bd020a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1219313 Dec 08 11:35:19.155184 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c677ee78-f617-4a45-bf99-82dcf405e36a req-f68b5e67-010a-4d35-b116-ab4a47a09844 service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1511827 Dec 08 11:35:19.190688 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8799cb8-bf91-4317-bda3-6afe337f79d6 req-9e450143-f079-4943-9f9e-1f4a953a79cb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:19.192154 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c8799cb8-bf91-4317-bda3-6afe337f79d6 req-9e450143-f079-4943-9f9e-1f4a953a79cb tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0522909 Dec 08 11:35:19.292071 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c8799cb8-bf91-4317-bda3-6afe337f79d6 req-62a2c2d6-5aa5-4521-b707-034685915aff tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0938740 Dec 08 11:35:19.316559 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c677ee78-f617-4a45-bf99-82dcf405e36a req-4d3978e7-6a14-4ffc-ba0d-676a52186779 service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1173499 Dec 08 11:35:19.682019 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f0a890-b9ab-4472-ad89-156250adb460 req-edca39f1-65fe-44da-b3b9-448900d65fc2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:19.683510 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98f0a890-b9ab-4472-ad89-156250adb460 req-edca39f1-65fe-44da-b3b9-448900d65fc2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0801306 Dec 08 11:35:19.698158 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc858685-e110-44e3-b428-e69af435af84 req-a5554546-82e2-4da9-98fc-efadb8a34ada tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:19.699594 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fc858685-e110-44e3-b428-e69af435af84 req-a5554546-82e2-4da9-98fc-efadb8a34ada tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0670440 Dec 08 11:35:19.775050 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98f0a890-b9ab-4472-ad89-156250adb460 req-07df4504-72c0-4c97-89c9-c3b9c90d995d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0850310 Dec 08 11:35:19.778235 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fc858685-e110-44e3-b428-e69af435af84 req-8640a92f-7ffe-4c60-a864-92f338a5f4cb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720723 Dec 08 11:35:20.053996 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:35:20.149916 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:20.162881 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'port_id': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'mac_address': 'fa:16:3e:f5:f7:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 278, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:35:20.196531 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11b259bb-15f9-42c2-a9ac-e75c88932c53 req-cf737229-f85c-48f9-91d0-18d680d3f025 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:20.201254 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:20.206739 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-11b259bb-15f9-42c2-a9ac-e75c88932c53 req-cf737229-f85c-48f9-91d0-18d680d3f025 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 943 time: 0.0623510 Dec 08 11:35:20.216308 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:35:20.239589 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:20.245490 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:20.290593 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-11b259bb-15f9-42c2-a9ac-e75c88932c53 req-6af0ac7d-72eb-4e56-a73f-3de0f584df7f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0826452 Dec 08 11:35:20.298186 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,revision_number=6']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:20.304466 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56db5fef-2d4f-4bf0-baec-604af78984e6 req-a0296a08-9fb2-4ddb-a1c3-a5ad98704f5e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:20.306533 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-56db5fef-2d4f-4bf0-baec-604af78984e6 req-a0296a08-9fb2-4ddb-a1c3-a5ad98704f5e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0901403 Dec 08 11:35:20.358927 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-56db5fef-2d4f-4bf0-baec-604af78984e6 req-6f27e510-dcd2-49b7-831c-bf1889e9f71f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410445 Dec 08 11:35:20.410536 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bca84f39-c59a-484f-bde7-427eb8207ad7 req-69da1976-c80d-4789-a8d0-209540a78519 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:20.412711 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bca84f39-c59a-484f-bde7-427eb8207ad7 req-69da1976-c80d-4789-a8d0-209540a78519 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0527468 Dec 08 11:35:20.460072 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bca84f39-c59a-484f-bde7-427eb8207ad7 req-5d19dec5-5780-4a64-92c8-7bb0c05ea88e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413144 Dec 08 11:35:20.715244 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['2ebdbac7-6fba-4bd2-bbec-7e49216db3fe'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:35:20.914708 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f158c0b7-9ee7-43f8-95c5-ec8d2755c9f5 req-4aefbba0-9d06-454f-a399-ef946437bd88 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:20.916164 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f158c0b7-9ee7-43f8-95c5-ec8d2755c9f5 req-4aefbba0-9d06-454f-a399-ef946437bd88 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0723453 Dec 08 11:35:20.928742 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aedb735c-8b69-41d5-916b-6d85069af404 req-1908d8e0-7ba0-4ffe-baed-e749c59eb8d7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:20.930147 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-aedb735c-8b69-41d5-916b-6d85069af404 req-1908d8e0-7ba0-4ffe-baed-e749c59eb8d7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0769765 Dec 08 11:35:21.004627 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f158c0b7-9ee7-43f8-95c5-ec8d2755c9f5 req-12ee2145-d78a-4d8b-8032-82cd66c51126 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0734675 Dec 08 11:35:21.007720 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-aedb735c-8b69-41d5-916b-6d85069af404 req-bc0ca73f-525e-4b04-b4fa-79bb14511033 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712254 Dec 08 11:35:21.408459 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fe6a2c2-f65d-4ae0-8db2-a82059ca7687 req-843bad9d-82d7-4b09-941b-137e44ae37be tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:21.410225 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3fe6a2c2-f65d-4ae0-8db2-a82059ca7687 req-843bad9d-82d7-4b09-941b-137e44ae37be tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 943 time: 0.0499775 Dec 08 11:35:21.483829 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3fe6a2c2-f65d-4ae0-8db2-a82059ca7687 req-a50e5758-5d2a-40cf-9c21-db2b769830ba tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658922 Dec 08 11:35:21.497811 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dcc8627-ce81-4e5c-8e7f-f80430ce30ff req-d5ac2433-e102-4e04-b120-84bcbb35f2c7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:21.499241 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6dcc8627-ce81-4e5c-8e7f-f80430ce30ff req-d5ac2433-e102-4e04-b120-84bcbb35f2c7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 945 time: 0.0668356 Dec 08 11:35:21.549083 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6dcc8627-ce81-4e5c-8e7f-f80430ce30ff req-24c3446a-a681-46b3-b467-ed730d73be67 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434678 Dec 08 11:35:22.082351 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:35:22.135815 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:35:22.136185 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:22.216676 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:22.241531 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:35:22.243795 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a52f0909-ad47-4a79-a47f-3794f8a356f5" -d '{"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-plugged", "status": "completed", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:35:22.256971 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:22.261004 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:22.313225 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,revision_number=7']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:22.321018 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:22.321341 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:22.321698 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:22.322052 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:22.322366 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:22.322691 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:22.323014 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:22.323335 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:22.323673 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:22.324017 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:22.324367 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:22.324656 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:22.324971 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:22.396924 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64b13278-5406-48a4-b812-5fcf9bcd85bf req-2b2744fc-030f-4f67-a8a7-f06058924b95 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:22.398430 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-64b13278-5406-48a4-b812-5fcf9bcd85bf req-2b2744fc-030f-4f67-a8a7-f06058924b95 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.3029890 Dec 08 11:35:22.406330 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41155e89-b479-43bc-ad80-8a4a0091d959 req-f08240c8-7752-4ae4-ad97-4c37c96456e5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:22.407682 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-41155e89-b479-43bc-ad80-8a4a0091d959 req-f08240c8-7752-4ae4-ad97-4c37c96456e5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.3331037 Dec 08 11:35:22.461862 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9cfe99e7-e1fa-4170-8aea-2d0c00963632 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:22.485806 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-64b13278-5406-48a4-b812-5fcf9bcd85bf req-8ff55a21-5b64-413f-bf88-dff33a0f97ca tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0771849 Dec 08 11:35:22.490279 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-41155e89-b479-43bc-ad80-8a4a0091d959 req-b32e3efc-d833-4ba1-a462-461ad2491d64 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0755432 Dec 08 11:35:22.529418 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:35:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7ed7397-92c7-4859-8d24-cadd24d541c7 x-openstack-request-id: req-b7ed7397-92c7-4859-8d24-cadd24d541c7 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:35:22.529715 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-plugged", "status": "completed", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:35:22.529973 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-b7ed7397-92c7-4859-8d24-cadd24d541c7 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:35:22.530365 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'code': 200} Dec 08 11:35:22.602478 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27d8c25c-c9ca-4c91-a275-fb01c9337c67 req-2be9f2e6-e1ab-4e8b-b491-5de0e38cfc1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:22.603978 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-27d8c25c-c9ca-4c91-a275-fb01c9337c67 req-2be9f2e6-e1ab-4e8b-b491-5de0e38cfc1b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 943 time: 0.0494211 Dec 08 11:35:22.679203 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-27d8c25c-c9ca-4c91-a275-fb01c9337c67 req-ad544e6a-3265-4c39-b80a-30a8de1a14cc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692747 Dec 08 11:35:22.689667 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f30cfbc-56ee-4c78-8647-0f9a2c281fc9 req-96522471-c43e-4f82-b3c6-8a6d0c14991c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:22.691188 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3f30cfbc-56ee-4c78-8647-0f9a2c281fc9 req-96522471-c43e-4f82-b3c6-8a6d0c14991c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0684161 Dec 08 11:35:22.737742 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3f30cfbc-56ee-4c78-8647-0f9a2c281fc9 req-d6d354b4-2589-4239-a6e2-b8c554a53f93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407257 Dec 08 11:35:23.630609 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-965549d7-68be-45b6-8426-a7970cd954ce req-96388221-c05b-45bf-b6cc-ebea7f39c9d6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:23.632002 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-965549d7-68be-45b6-8426-a7970cd954ce req-96388221-c05b-45bf-b6cc-ebea7f39c9d6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0799801 Dec 08 11:35:23.639892 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-775a5d55-6e0b-451d-a7db-ca0c13db35a0 req-de8b463a-b4ea-4cac-b719-d9b9dc159e40 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:23.641267 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-775a5d55-6e0b-451d-a7db-ca0c13db35a0 req-de8b463a-b4ea-4cac-b719-d9b9dc159e40 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0804970 Dec 08 11:35:23.712012 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-965549d7-68be-45b6-8426-a7970cd954ce req-7e2270fb-bb1d-46a4-a70d-71463f47f896 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698149 Dec 08 11:35:23.716704 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-775a5d55-6e0b-451d-a7db-ca0c13db35a0 req-bae94682-53cd-46dd-a2d0-47ae92b247dc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0687125 Dec 08 11:35:23.813803 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d11fb6-386c-48e2-909e-6fffde2a1d64 req-9a3cc39b-0fdc-467c-93f1-922ed5cac491 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:23.815287 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b7d11fb6-386c-48e2-909e-6fffde2a1d64 req-9a3cc39b-0fdc-467c-93f1-922ed5cac491 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 943 time: 0.0495534 Dec 08 11:35:23.893510 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0c9e44e-3279-4f66-b3e8-07064c654a05 req-f228eb7d-8a1a-478b-98b1-06ec2976e45b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:23.894885 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d0c9e44e-3279-4f66-b3e8-07064c654a05 req-f228eb7d-8a1a-478b-98b1-06ec2976e45b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0787358 Dec 08 11:35:23.898427 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b7d11fb6-386c-48e2-909e-6fffde2a1d64 req-a25b897b-df5e-43a8-a17a-0b808d7d5eaf tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0742333 Dec 08 11:35:23.941889 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d0c9e44e-3279-4f66-b3e8-07064c654a05 req-99a0d9fc-3e88-428e-9dd9-ec7cf1573d3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411403 Dec 08 11:35:24.100293 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 222531bb-d35b-49bb-b52a-9b0f529866e2 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:35:24.197221 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 222531bb-d35b-49bb-b52a-9b0f529866e2, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=222531bb-d35b-49bb-b52a-9b0f529866e2,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:24.209942 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '222531bb-d35b-49bb-b52a-9b0f529866e2', 'network_id': '6e4bda07-1ae1-4be4-bf28-e94211f51919', 'port_id': '222531bb-d35b-49bb-b52a-9b0f529866e2', 'mac_address': 'fa:16:3e:63:00:ec', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 277, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd6b1fb0e-d38f-47ca-a647-53b824c47e76', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:35:24.252980 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:24.267567 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 222531bb-d35b-49bb-b52a-9b0f529866e2 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:35:24.288252 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 222531bb-d35b-49bb-b52a-9b0f529866e2, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=222531bb-d35b-49bb-b52a-9b0f529866e2,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:24.292326 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:24.341542 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=222531bb-d35b-49bb-b52a-9b0f529866e2,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:24.356073 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e8a998-2f70-45ed-9662-c5d4182bdb03 req-e7e848df-bc98-41cc-804b-7a7e1a3e70a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:24.357597 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22e8a998-2f70-45ed-9662-c5d4182bdb03 req-e7e848df-bc98-41cc-804b-7a7e1a3e70a7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 945 time: 0.0504196 Dec 08 11:35:24.406220 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22e8a998-2f70-45ed-9662-c5d4182bdb03 req-8a3ff889-771e-4976-9217-882251dd8b0d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424902 Dec 08 11:35:24.688892 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-880dd280-536e-4d2c-8074-9df31cfffda6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:24.862886 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed402d7c-f4a8-41ec-a0ef-ba8f888371e0 req-523c036d-b465-40e8-89f6-79ae585a5bd0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:24.864362 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ed402d7c-f4a8-41ec-a0ef-ba8f888371e0 req-523c036d-b465-40e8-89f6-79ae585a5bd0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0824604 Dec 08 11:35:24.876707 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85dfa18a-c670-4593-8974-ac14ae80aa24 req-ea700915-7909-4432-bc8a-625aac149870 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:24.879071 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85dfa18a-c670-4593-8974-ac14ae80aa24 req-ea700915-7909-4432-bc8a-625aac149870 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0670254 Dec 08 11:35:24.896421 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:35:24.927632 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['222531bb-d35b-49bb-b52a-9b0f529866e2'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:35:24.953488 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ed402d7c-f4a8-41ec-a0ef-ba8f888371e0 req-757978b3-75b1-44eb-8b0f-a23a5cf2022c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0733407 Dec 08 11:35:24.957485 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85dfa18a-c670-4593-8974-ac14ae80aa24 req-dac78034-c403-4d4c-b3a5-784f2e82d46c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0718050 Dec 08 11:35:25.095872 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b552820-72f2-46ca-b078-8df4ee74730a req-18dfe121-7237-4e83-b6ae-fb5062275c98 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:25.098038 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b552820-72f2-46ca-b078-8df4ee74730a req-18dfe121-7237-4e83-b6ae-fb5062275c98 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0737050 Dec 08 11:35:25.105434 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ae68ac-fcd8-495e-bea2-ec4ebb0c1088 req-a64e499f-7bed-45e6-b4b3-70935dd4d592 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:25.106909 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-00ae68ac-fcd8-495e-bea2-ec4ebb0c1088 req-a64e499f-7bed-45e6-b4b3-70935dd4d592 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 944 time: 0.0933182 Dec 08 11:35:25.180333 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b552820-72f2-46ca-b078-8df4ee74730a req-ab8d2318-90fa-4035-ba95-e6c5d00fe220 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0724409 Dec 08 11:35:25.183485 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-00ae68ac-fcd8-495e-bea2-ec4ebb0c1088 req-62a8de46-5ef1-4312-a472-9d16c67255bb tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692513 Dec 08 11:35:25.517781 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aae013f-1ddd-408e-b3db-9fbe07e8a607 req-4af16db1-e2bd-4299-896e-ead7deb1c403 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:25.519204 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9aae013f-1ddd-408e-b3db-9fbe07e8a607 req-4af16db1-e2bd-4299-896e-ead7deb1c403 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 945 time: 0.0479138 Dec 08 11:35:25.569367 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9aae013f-1ddd-408e-b3db-9fbe07e8a607 req-a6b24cb1-9f30-47ea-9489-9f8d72f5f357 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410142 Dec 08 11:35:25.770166 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:26.104877 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c4b258-8b5a-4f18-833c-bbd997d4c8d6 req-79888fac-9e0a-40e0-a3e1-d2b3ef413e94 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:26.106556 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-91c4b258-8b5a-4f18-833c-bbd997d4c8d6 req-79888fac-9e0a-40e0-a3e1-d2b3ef413e94 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0821896 Dec 08 11:35:26.127940 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec865c1-adc7-4c2f-af7d-c30cc94ce64f req-12cf6da6-f329-4497-a828-dd4cc4338859 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:26.129513 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1ec865c1-adc7-4c2f-af7d-c30cc94ce64f req-12cf6da6-f329-4497-a828-dd4cc4338859 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0740180 Dec 08 11:35:26.196161 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-91c4b258-8b5a-4f18-833c-bbd997d4c8d6 req-681eaf67-2153-4add-922e-ea997307fd82 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0816357 Dec 08 11:35:26.207300 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1ec865c1-adc7-4c2f-af7d-c30cc94ce64f req-b2e85d79-8041-416a-a41d-0d7b0112cc05 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0697057 Dec 08 11:35:26.340725 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e11c989-1f33-454e-b3cc-74531a579599 req-3063f513-f339-40a4-bbcc-3e5ea1502052 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:26.343804 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7e11c989-1f33-454e-b3cc-74531a579599 req-3063f513-f339-40a4-bbcc-3e5ea1502052 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0857513 Dec 08 11:35:26.357407 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b7640d1-7032-4183-9259-ef211d1f5d7f req-fd7ca5a9-c1fa-49ff-ba2f-d8c0222b7b1c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:26.358837 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9b7640d1-7032-4183-9259-ef211d1f5d7f req-fd7ca5a9-c1fa-49ff-ba2f-d8c0222b7b1c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 944 time: 0.0751076 Dec 08 11:35:26.429783 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7e11c989-1f33-454e-b3cc-74531a579599 req-bcbfdf4a-8b1c-4c20-8b52-9920b41e2e1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0802219 Dec 08 11:35:26.433352 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9b7640d1-7032-4183-9259-ef211d1f5d7f req-0b4574cc-5453-4617-b170-e2100d13b0a1 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0679445 Dec 08 11:35:26.698951 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39038f49-ea47-4df6-a6a9-76e8a8ece7ed req-4af588ee-e663-4ff5-a089-2eb00f8dd81a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:26.700565 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-39038f49-ea47-4df6-a6a9-76e8a8ece7ed req-4af588ee-e663-4ff5-a089-2eb00f8dd81a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 945 time: 0.0535622 Dec 08 11:35:26.754896 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-39038f49-ea47-4df6-a6a9-76e8a8ece7ed req-7c7e684d-8b30-42b9-9e23-f843e352f15b tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457277 Dec 08 11:35:26.905917 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d882842-6d18-4826-ab29-58d6fec9fa82 req-1024991d-4d3d-40ba-bb04-4e6e67449937 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:26.907311 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9d882842-6d18-4826-ab29-58d6fec9fa82 req-1024991d-4d3d-40ba-bb04-4e6e67449937 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.61 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 945 time: 0.0562534 Dec 08 11:35:27.025644 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-9d882842-6d18-4826-ab29-58d6fec9fa82 req-08c7f38c-431b-4878-83a1-01b2d0d5e0a3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Deleting port 111e4836-2539-424a-86c3-da84a2a2dc76 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:35:27.026349 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-9d882842-6d18-4826-ab29-58d6fec9fa82 req-08c7f38c-431b-4878-83a1-01b2d0d5e0a3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:27.132355 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-9d882842-6d18-4826-ab29-58d6fec9fa82 req-08c7f38c-431b-4878-83a1-01b2d0d5e0a3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] For port 111e4836-2539-424a-86c3-da84a2a2dc76, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=111e4836-2539-424a-86c3-da84a2a2dc76,segment=NetworkSegment(93ea5ca7-22ef-4002-8579-aa09922044a7),segment_id=93ea5ca7-22ef-4002-8579-aa09922044a7)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:27.133007 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:27.133607 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-9d882842-6d18-4826-ab29-58d6fec9fa82 req-08c7f38c-431b-4878-83a1-01b2d0d5e0a3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:27.151812 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-9d882842-6d18-4826-ab29-58d6fec9fa82 req-08c7f38c-431b-4878-83a1-01b2d0d5e0a3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling delete_port for 111e4836-2539-424a-86c3-da84a2a2dc76 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:35:27.363321 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-9d882842-6d18-4826-ab29-58d6fec9fa82 req-08c7f38c-431b-4878-83a1-01b2d0d5e0a3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:27.382169 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['111e4836-2539-424a-86c3-da84a2a2dc76'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:35:27.402837 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08c7f38c-431b-4878-83a1-01b2d0d5e0a3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Pushing event deleted for resources: {'Port': ['ID=111e4836-2539-424a-86c3-da84a2a2dc76,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:27.448079 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09da79e1-2535-4e5c-8677-7ed8d5256505 req-c814e304-c5df-4d45-8de6-b8e45bd0a188 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:27.455881 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-09da79e1-2535-4e5c-8677-7ed8d5256505 req-c814e304-c5df-4d45-8de6-b8e45bd0a188 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.1468604 Dec 08 11:35:27.485989 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d1ac0c6-567f-408e-a550-a2f642343e73 req-50dc4a9e-dc69-48b4-9197-121d2d967290 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:27.487510 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9d1ac0c6-567f-408e-a550-a2f642343e73 req-50dc4a9e-dc69-48b4-9197-121d2d967290 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.1774189 Dec 08 11:35:27.488349 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-9d882842-6d18-4826-ab29-58d6fec9fa82 req-08c7f38c-431b-4878-83a1-01b2d0d5e0a3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] No DVR routers for this DVR port 111e4836-2539-424a-86c3-da84a2a2dc76 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:35:27.491727 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-9d882842-6d18-4826-ab29-58d6fec9fa82 req-08c7f38c-431b-4878-83a1-01b2d0d5e0a3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:27.495073 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9d882842-6d18-4826-ab29-58d6fec9fa82 req-08c7f38c-431b-4878-83a1-01b2d0d5e0a3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.61 "DELETE /v2.0/ports/111e4836-2539-424a-86c3-da84a2a2dc76 HTTP/1.1" status: 204 len: 173 time: 0.5800197 Dec 08 11:35:27.495582 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9350ab5c-81eb-4a90-8a3b-266dc3794bb9', 'name': 'network-vif-deleted', 'tag': '111e4836-2539-424a-86c3-da84a2a2dc76'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:35:27.498591 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68fd4d92-23ae-42eb-bddb-017fea82bd2f" -d '{"events": [{"server_uuid": "9350ab5c-81eb-4a90-8a3b-266dc3794bb9", "name": "network-vif-deleted", "tag": "111e4836-2539-424a-86c3-da84a2a2dc76"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:35:27.572766 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-09da79e1-2535-4e5c-8677-7ed8d5256505 req-c3593c17-467a-454a-bfa3-b9caa3372754 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1158485 Dec 08 11:35:27.588648 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9d1ac0c6-567f-408e-a550-a2f642343e73 req-ad522e67-af34-4a9c-92ef-f1d3ac96b911 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0796084 Dec 08 11:35:27.724719 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f818682-d749-4144-9cc2-97622279ad6d req-257e01c9-fbaa-48f5-92f5-e984f6e41c6b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:27.726414 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5f818682-d749-4144-9cc2-97622279ad6d req-257e01c9-fbaa-48f5-92f5-e984f6e41c6b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 944 time: 0.0779133 Dec 08 11:35:27.760275 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35832010-b4c7-4a7b-a90b-4689d99509e7 req-8d40a494-b563-4362-97c8-9b6207b5536a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:27.766077 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-35832010-b4c7-4a7b-a90b-4689d99509e7 req-8d40a494-b563-4362-97c8-9b6207b5536a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0794232 Dec 08 11:35:27.819144 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5f818682-d749-4144-9cc2-97622279ad6d req-750f09d3-e02e-4efc-985f-3e4fc813ca4c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0844612 Dec 08 11:35:27.849842 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-35832010-b4c7-4a7b-a90b-4689d99509e7 req-c5a28574-bf7b-494c-b3b3-b2aec5b8928f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0784569 Dec 08 11:35:27.891245 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:35:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-086d1ed8-8200-4bd0-8e03-c2eed5865ca9 x-openstack-request-id: req-086d1ed8-8200-4bd0-8e03-c2eed5865ca9 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:35:27.891774 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9350ab5c-81eb-4a90-8a3b-266dc3794bb9", "name": "network-vif-deleted", "tag": "111e4836-2539-424a-86c3-da84a2a2dc76", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:35:27.892388 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-086d1ed8-8200-4bd0-8e03-c2eed5865ca9 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:35:27.892946 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9350ab5c-81eb-4a90-8a3b-266dc3794bb9', 'name': 'network-vif-deleted', 'tag': '111e4836-2539-424a-86c3-da84a2a2dc76', 'status': 'completed', 'code': 200} Dec 08 11:35:27.953820 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2767138f-f82a-47a4-805f-41357e085a1f req-5ffd1ad6-3504-4171-970b-c29d5fcf0d02 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=9350ab5c-81eb-4a90-8a3b-266dc3794bb9 HTTP/1.1" status: 200 len: 210 time: 0.0285127 Dec 08 11:35:28.117988 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 79e98205-d459-4886-827e-71b058999e30 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:35:28.121246 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 222531bb-d35b-49bb-b52a-9b0f529866e2 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:35:28.225456 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:28.272247 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 222531bb-d35b-49bb-b52a-9b0f529866e2 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:35:28.288245 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 222531bb-d35b-49bb-b52a-9b0f529866e2 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:35:28.288618 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:28.324678 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 79e98205-d459-4886-827e-71b058999e30, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=79e98205-d459-4886-827e-71b058999e30,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:28.345591 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '79e98205-d459-4886-827e-71b058999e30', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'port_id': '79e98205-d459-4886-827e-71b058999e30', 'mac_address': 'fa:16:3e:dd:98:56', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 262, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59081569-032b-42c0-afce-26c79ceb7aac', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:35:28.395383 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:28.439299 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 79e98205-d459-4886-827e-71b058999e30 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:35:28.446220 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:28.479060 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 79e98205-d459-4886-827e-71b058999e30, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=79e98205-d459-4886-827e-71b058999e30,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:28.487146 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16a3dc0f-c35b-4f26-b4da-455158247814', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '222531bb-d35b-49bb-b52a-9b0f529866e2'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:35:28.489454 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7954c27-ee44-4917-8c0d-74b38a7ec7db" -d '{"events": [{"server_uuid": "16a3dc0f-c35b-4f26-b4da-455158247814", "name": "network-vif-plugged", "status": "completed", "tag": "222531bb-d35b-49bb-b52a-9b0f529866e2"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:35:28.494752 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:28.506390 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 222531bb-d35b-49bb-b52a-9b0f529866e2, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=222531bb-d35b-49bb-b52a-9b0f529866e2,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:28.526856 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:28.554390 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=79e98205-d459-4886-827e-71b058999e30,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:28.561469 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:35:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cbae5fa5-1849-49b0-8ee5-24b457fed75e x-openstack-request-id: req-cbae5fa5-1849-49b0-8ee5-24b457fed75e {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:35:28.561904 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16a3dc0f-c35b-4f26-b4da-455158247814", "name": "network-vif-plugged", "status": "completed", "tag": "222531bb-d35b-49bb-b52a-9b0f529866e2", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:35:28.562163 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-cbae5fa5-1849-49b0-8ee5-24b457fed75e {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:35:28.562664 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16a3dc0f-c35b-4f26-b4da-455158247814', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '222531bb-d35b-49bb-b52a-9b0f529866e2', 'code': 200} Dec 08 11:35:28.613165 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53daaab9-0a5b-4acb-b118-e94248a8cc1b req-92d38a15-a123-4d1c-9d91-b6a4a1edc195 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:28.615097 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-53daaab9-0a5b-4acb-b118-e94248a8cc1b req-92d38a15-a123-4d1c-9d91-b6a4a1edc195 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 1098 time: 0.0595646 Dec 08 11:35:28.629032 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=222531bb-d35b-49bb-b52a-9b0f529866e2,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:28.677127 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-53daaab9-0a5b-4acb-b118-e94248a8cc1b req-4a6f422b-e4c4-4f02-950c-35c9689efb8d service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454733 Dec 08 11:35:28.783238 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93dcc6dc-0793-4a47-a66a-0585b5f0b257 req-4fecad02-2477-477e-b7c3-ef06db45c7b0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:28.784984 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-93dcc6dc-0793-4a47-a66a-0585b5f0b257 req-4fecad02-2477-477e-b7c3-ef06db45c7b0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 944 time: 0.0721223 Dec 08 11:35:28.797483 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2bfba57-1de5-4b96-82c9-d93b7124d0ef req-7990768d-33fd-41f2-aa54-21c3b7ac57aa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:28.805897 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f2bfba57-1de5-4b96-82c9-d93b7124d0ef req-7990768d-33fd-41f2-aa54-21c3b7ac57aa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.1030176 Dec 08 11:35:28.883351 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f2bfba57-1de5-4b96-82c9-d93b7124d0ef req-9b5b2c14-b9cf-47df-a177-655af18ff10c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763719 Dec 08 11:35:28.887627 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-93dcc6dc-0793-4a47-a66a-0585b5f0b257 req-c5611e8d-01a3-4bf1-b844-4bea9d6a53b8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0790272 Dec 08 11:35:29.027433 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['79e98205-d459-4886-827e-71b058999e30'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:35:29.044435 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06f02838-9496-4be5-90e6-3d00c329c7cf req-bf2b1ac1-3848-404b-91a5-8dbae1c4a5bd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:29.052352 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-06f02838-9496-4be5-90e6-3d00c329c7cf req-bf2b1ac1-3848-404b-91a5-8dbae1c4a5bd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.1006722 Dec 08 11:35:29.075372 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cf08acd-e45c-4822-a813-ebefba2d9390 req-fd162ffb-ddd7-4afa-9c70-36f39e52e915 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:29.076303 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2cf08acd-e45c-4822-a813-ebefba2d9390 req-fd162ffb-ddd7-4afa-9c70-36f39e52e915 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.1228912 Dec 08 11:35:29.164993 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-06f02838-9496-4be5-90e6-3d00c329c7cf req-58f33e61-08fa-4f1c-b3b0-1f624ba481ff tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1116812 Dec 08 11:35:29.171724 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e9cef20-64b2-49c2-8d18-156bc91a9ab5 req-700965a6-47f1-412d-8a6c-1392b7dbb942 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:29.173219 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1e9cef20-64b2-49c2-8d18-156bc91a9ab5 req-700965a6-47f1-412d-8a6c-1392b7dbb942 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 1098 time: 0.1506991 Dec 08 11:35:29.182390 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2cf08acd-e45c-4822-a813-ebefba2d9390 req-c81ce94d-2fcb-40a4-b70a-bc9ea21d5528 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0915720 Dec 08 11:35:29.276913 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1e9cef20-64b2-49c2-8d18-156bc91a9ab5 req-4aca4f5e-6cfb-4cb4-b821-8e6394ceeb61 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0934751 Dec 08 11:35:30.047872 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be476233-a338-4221-8615-a73e6dd95180 req-568372e9-b121-4e9a-8cbf-0b0e486970e9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:30.050330 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-be476233-a338-4221-8615-a73e6dd95180 req-568372e9-b121-4e9a-8cbf-0b0e486970e9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0840051 Dec 08 11:35:30.074630 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eecc981-4c07-43fe-a2df-88de195b01fb req-2ffe420e-b27e-45ae-9c6e-08a5ef7ff59b tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:30.076255 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0eecc981-4c07-43fe-a2df-88de195b01fb req-2ffe420e-b27e-45ae-9c6e-08a5ef7ff59b tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 944 time: 0.0836909 Dec 08 11:35:30.133342 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 111e4836-2539-424a-86c3-da84a2a2dc76 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:35:30.164468 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 111e4836-2539-424a-86c3-da84a2a2dc76 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:35:30.165679 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 111e4836-2539-424a-86c3-da84a2a2dc76 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:35:30.175889 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-be476233-a338-4221-8615-a73e6dd95180 req-1da31206-f1cd-49d7-948e-667017399a03 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1154392 Dec 08 11:35:30.186624 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0eecc981-4c07-43fe-a2df-88de195b01fb req-9274a1c1-d69a-4f1c-a519-c8d02b6eb249 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0958636 Dec 08 11:35:30.345825 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a9a376-1c2c-4fdb-bad4-77fb988610f0 req-e1d9df8f-04af-426d-8fd5-447d27f7cd76 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:30.347876 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-65a9a376-1c2c-4fdb-bad4-77fb988610f0 req-e1d9df8f-04af-426d-8fd5-447d27f7cd76 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0949063 Dec 08 11:35:30.366991 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7abfc3ca-553f-4291-aa2f-28c94b26ec59 req-c5c9f9cf-97e0-446e-b604-4ac9be8b785b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:30.368434 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7abfc3ca-553f-4291-aa2f-28c94b26ec59 req-c5c9f9cf-97e0-446e-b604-4ac9be8b785b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0869954 Dec 08 11:35:30.444547 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-65a9a376-1c2c-4fdb-bad4-77fb988610f0 req-74330747-450a-4ae0-a47f-1bace7c4acf7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0893753 Dec 08 11:35:30.461731 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7abfc3ca-553f-4291-aa2f-28c94b26ec59 req-027eeadd-7c42-43a4-aa95-6cb7ef0cac58 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0861130 Dec 08 11:35:31.336605 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad5fbca9-3fce-4526-a412-34b5ede366ea req-933eb764-e4eb-462c-bff0-e941ea1f7a78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:31.338628 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ad5fbca9-3fce-4526-a412-34b5ede366ea req-933eb764-e4eb-462c-bff0-e941ea1f7a78 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0817235 Dec 08 11:35:31.367498 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59fa7faf-79ed-4c9f-8472-e588df0d4c44 req-0be88be3-82d7-42ff-8198-b2eb03d54b0a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:31.368977 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-59fa7faf-79ed-4c9f-8472-e588df0d4c44 req-0be88be3-82d7-42ff-8198-b2eb03d54b0a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 944 time: 0.0989518 Dec 08 11:35:31.439080 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ad5fbca9-3fce-4526-a412-34b5ede366ea req-fbbd7c00-3a9a-4748-b1f3-8b21478bb826 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903082 Dec 08 11:35:31.468347 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-59fa7faf-79ed-4c9f-8472-e588df0d4c44 req-dd768463-727a-44ac-84f9-2d272537286f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0888813 Dec 08 11:35:31.632586 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d582cb18-00e7-4fc0-b66b-dc183a05b0e9 req-23b7f982-3d9c-4c4f-b20d-2ddfb8ba5382 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:31.634040 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d582cb18-00e7-4fc0-b66b-dc183a05b0e9 req-23b7f982-3d9c-4c4f-b20d-2ddfb8ba5382 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0999451 Dec 08 11:35:31.669842 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188b9262-5b52-4261-9189-42b7d7a9b1c1 req-4ed9593f-5503-4e87-a234-48dce4e07aa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:31.671322 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-188b9262-5b52-4261-9189-42b7d7a9b1c1 req-4ed9593f-5503-4e87-a234-48dce4e07aa9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0988257 Dec 08 11:35:31.723331 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d582cb18-00e7-4fc0-b66b-dc183a05b0e9 req-8818bdcc-06ca-42c9-99e5-9d23daff082b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822902 Dec 08 11:35:31.758132 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-188b9262-5b52-4261-9189-42b7d7a9b1c1 req-90138a35-7be2-4c63-a887-87599cc686a3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0785680 Dec 08 11:35:32.645388 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24b3051a-4cb7-4310-973d-901ee6dfe4ab req-8f47a127-1f55-467d-8eda-6ac49c6bffea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:32.646910 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-24b3051a-4cb7-4310-973d-901ee6dfe4ab req-8f47a127-1f55-467d-8eda-6ac49c6bffea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0888512 Dec 08 11:35:32.660498 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30b727fd-f74e-4031-bda3-244b162c3a06 req-153e57a0-bd79-405b-bcfb-148b5ad3f586 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:32.662032 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-30b727fd-f74e-4031-bda3-244b162c3a06 req-153e57a0-bd79-405b-bcfb-148b5ad3f586 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 944 time: 0.0940742 Dec 08 11:35:32.736528 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-30b727fd-f74e-4031-bda3-244b162c3a06 req-7223cd43-7ecd-423f-bb3e-bc55def97b45 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0675423 Dec 08 11:35:32.745720 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-24b3051a-4cb7-4310-973d-901ee6dfe4ab req-21f176ba-2f94-4f1c-b46d-08c9f566a975 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0826344 Dec 08 11:35:32.881269 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f78084ed-20ed-40dc-b7d0-3f93651478d9 req-267ed1c5-48a9-4af6-8362-c9044c52766e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:32.882846 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f78084ed-20ed-40dc-b7d0-3f93651478d9 req-267ed1c5-48a9-4af6-8362-c9044c52766e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0722673 Dec 08 11:35:32.958407 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a4e68e0-cf27-44ca-84f4-89932fa94139 req-12c04700-9617-40ab-ad00-a139fdd77f1b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:32.959860 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0a4e68e0-cf27-44ca-84f4-89932fa94139 req-12c04700-9617-40ab-ad00-a139fdd77f1b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0948699 Dec 08 11:35:32.966844 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f78084ed-20ed-40dc-b7d0-3f93651478d9 req-115bd241-2f5f-4857-8d6f-826590f594ec tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0629358 Dec 08 11:35:33.012381 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0a4e68e0-cf27-44ca-84f4-89932fa94139 req-b47b6ab1-d4aa-4128-8892-b00bbe7fac24 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443482 Dec 08 11:35:33.905980 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accbf81e-8fc7-4275-95f7-6ab7ab8c6685 req-8768e3ed-2502-4811-86df-5518bd350988 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:33.913963 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-accbf81e-8fc7-4275-95f7-6ab7ab8c6685 req-8768e3ed-2502-4811-86df-5518bd350988 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 944 time: 0.0885546 Dec 08 11:35:33.930617 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf40f187-3b83-4417-87bd-72005695d3de req-a16c8858-a339-4689-a2a9-9e3a90d9a06e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:33.933443 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf40f187-3b83-4417-87bd-72005695d3de req-a16c8858-a339-4689-a2a9-9e3a90d9a06e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0990753 Dec 08 11:35:34.022189 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-accbf81e-8fc7-4275-95f7-6ab7ab8c6685 req-bcb09dab-f1e4-4a45-bc75-577094f48775 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1070657 Dec 08 11:35:34.025782 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf40f187-3b83-4417-87bd-72005695d3de req-367b5cd4-2dfc-4a62-8840-1b7580e1fe4e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836740 Dec 08 11:35:34.197922 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fe12add-09b2-4583-900e-420a5c68b367 req-abeae5ea-dfdf-448c-a491-bd282124cad6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:34.199380 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4fe12add-09b2-4583-900e-420a5c68b367 req-abeae5ea-dfdf-448c-a491-bd282124cad6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0847573 Dec 08 11:35:34.208164 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-442968d3-a484-474d-8a28-38d4a04018cc req-16be73c2-4d84-4c83-89d1-2d1410fdbf90 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:34.209577 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-442968d3-a484-474d-8a28-38d4a04018cc req-16be73c2-4d84-4c83-89d1-2d1410fdbf90 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.1048894 Dec 08 11:35:34.286659 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4fe12add-09b2-4583-900e-420a5c68b367 req-7d2dce82-f249-4534-8b98-de9c3dd3b92b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0760086 Dec 08 11:35:34.297624 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-442968d3-a484-474d-8a28-38d4a04018cc req-efe6f345-c0cd-419d-a238-58755a10e7f5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721829 Dec 08 11:35:35.210240 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89014512-a7b6-4714-89ed-12365a9fe2ee req-1e003873-d6b7-4b02-ba68-24748ffb9911 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:35.212062 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-89014512-a7b6-4714-89ed-12365a9fe2ee req-1e003873-d6b7-4b02-ba68-24748ffb9911 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0886905 Dec 08 11:35:35.219748 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384f1f71-3405-4541-b298-522cee59a78f req-ca9f2a0d-01fe-4248-99bf-2bd5dfa8edd2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:35.221307 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-384f1f71-3405-4541-b298-522cee59a78f req-ca9f2a0d-01fe-4248-99bf-2bd5dfa8edd2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 944 time: 0.0962501 Dec 08 11:35:35.302432 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-384f1f71-3405-4541-b298-522cee59a78f req-55bf9b53-2866-416d-9d3c-79ed682076b6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0724232 Dec 08 11:35:35.305901 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-89014512-a7b6-4714-89ed-12365a9fe2ee req-be0ae77d-998c-40bc-b548-0226061f64b4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0825262 Dec 08 11:35:35.457817 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b201ea9a-7214-48d1-aa8b-e07bbe74c6ee req-c0f1de72-1d08-472c-80db-1ecd92e61c7e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:35.459453 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b201ea9a-7214-48d1-aa8b-e07bbe74c6ee req-c0f1de72-1d08-472c-80db-1ecd92e61c7e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0856683 Dec 08 11:35:35.471706 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ed6d9b-c031-41b3-bac8-55bae45106c5 req-4d28a5b0-8547-493d-a35b-6390bf0a081b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:35.473402 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-77ed6d9b-c031-41b3-bac8-55bae45106c5 req-4d28a5b0-8547-493d-a35b-6390bf0a081b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0711291 Dec 08 11:35:35.563955 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b201ea9a-7214-48d1-aa8b-e07bbe74c6ee req-40860d81-8647-4e7b-8e33-e4f6a61ab5b4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0894327 Dec 08 11:35:35.569609 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-77ed6d9b-c031-41b3-bac8-55bae45106c5 req-385b6db6-5f8c-4f7a-85d8-fab384d2e879 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0892720 Dec 08 11:35:36.311733 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 79e98205-d459-4886-827e-71b058999e30 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:35:36.387599 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 79e98205-d459-4886-827e-71b058999e30 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:35:36.392876 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 79e98205-d459-4886-827e-71b058999e30 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:35:36.394192 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:36.478201 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:36.509929 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79e98205-d459-4886-827e-71b058999e30'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:35:36.512550 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e2ef6b79-1729-4da2-8ce4-34559cfbaf73" -d '{"events": [{"server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "name": "network-vif-plugged", "status": "completed", "tag": "79e98205-d459-4886-827e-71b058999e30"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:35:36.527400 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 79e98205-d459-4886-827e-71b058999e30, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=79e98205-d459-4886-827e-71b058999e30,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:36.535617 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:36.558987 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efef80bb-1a82-41d3-8f24-bd558418a68b req-23a712ea-2697-401b-a783-ae25fab3bec9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:36.561170 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-efef80bb-1a82-41d3-8f24-bd558418a68b req-23a712ea-2697-401b-a783-ae25fab3bec9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.1626625 Dec 08 11:35:36.571541 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52d321ac-d43a-4803-a8e7-0d6a2dc05ba8 req-b589db17-af3e-4cb3-8e59-0d2a40acf213 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:36.573575 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-52d321ac-d43a-4803-a8e7-0d6a2dc05ba8 req-b589db17-af3e-4cb3-8e59-0d2a40acf213 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 944 time: 0.1385372 Dec 08 11:35:36.621785 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=79e98205-d459-4886-827e-71b058999e30,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:36.665616 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-52d321ac-d43a-4803-a8e7-0d6a2dc05ba8 req-36824eb7-c2e7-420d-aee7-2beb6a49c4b5 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0814981 Dec 08 11:35:36.669322 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-efef80bb-1a82-41d3-8f24-bd558418a68b req-6cfec191-ef11-4610-91dd-4a02eededb77 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0939610 Dec 08 11:35:36.725762 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:35:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8f9216f1-179e-4403-a49f-619bcc103069 x-openstack-request-id: req-8f9216f1-179e-4403-a49f-619bcc103069 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:35:36.726132 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "name": "network-vif-plugged", "status": "completed", "tag": "79e98205-d459-4886-827e-71b058999e30", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:35:36.726355 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-8f9216f1-179e-4403-a49f-619bcc103069 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:35:36.726768 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79e98205-d459-4886-827e-71b058999e30', 'code': 200} Dec 08 11:35:36.820144 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3253b4e-e8b9-4231-b72c-e19a512f1e1b req-e008bf34-e927-4b9f-895d-f89c72571285 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:36.821777 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d3253b4e-e8b9-4231-b72c-e19a512f1e1b req-e008bf34-e927-4b9f-895d-f89c72571285 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0637164 Dec 08 11:35:36.909302 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d3253b4e-e8b9-4231-b72c-e19a512f1e1b req-af43dc0e-6e38-42b5-862f-d7e6cead40e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0769932 Dec 08 11:35:36.933119 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac19253a-ec39-49bc-a1d2-a0c61320c1af req-baa9e297-06c1-4c7f-94a9-92f3312d56df tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:36.934742 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ac19253a-ec39-49bc-a1d2-a0c61320c1af req-baa9e297-06c1-4c7f-94a9-92f3312d56df tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.1119635 Dec 08 11:35:37.046329 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ac19253a-ec39-49bc-a1d2-a0c61320c1af req-a96e9d74-6672-4bf8-93bb-61c905114e65 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0925362 Dec 08 11:35:37.049186 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f93c00a4-6d9e-4afc-aced-12c850a8f29a req-62261648-a521-4296-81fe-6de7ca3f0d61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:37.051308 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f93c00a4-6d9e-4afc-aced-12c850a8f29a req-62261648-a521-4296-81fe-6de7ca3f0d61 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 1098 time: 0.0695574 Dec 08 11:35:37.106522 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f93c00a4-6d9e-4afc-aced-12c850a8f29a req-73c2a680-aecf-44c5-9ac2-9e7508a9de93 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474248 Dec 08 11:35:37.377506 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b98aa19d-392f-4d1f-aa7f-d170c878b99f req-cb06e3c9-b397-474f-a95c-8d8391c779b3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:37.378975 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b98aa19d-392f-4d1f-aa7f-d170c878b99f req-cb06e3c9-b397-474f-a95c-8d8391c779b3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0526206 Dec 08 11:35:37.429490 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b98aa19d-392f-4d1f-aa7f-d170c878b99f req-e77ecf8a-9d20-411f-a4fc-2e780d2278a3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446329 Dec 08 11:35:37.483995 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 req-31e06b74-e46a-4a8b-827b-3375eeffa8a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:37.485483 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 req-31e06b74-e46a-4a8b-827b-3375eeffa8a3 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=801ccccb4d7647de8e9558e07ebdc070&device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 1098 time: 0.0398581 Dec 08 11:35:37.576853 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 req-eb308110-abe0-4a11-8f01-52490561f27e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:37.578273 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 req-eb308110-abe0-4a11-8f01-52490561f27e service neutron] 10.222.0.61 "GET /v2.0/networks?id=b799b290-99c1-4693-82cc-42bbd4d90adb HTTP/1.1" status: 200 len: 920 time: 0.0820668 Dec 08 11:35:37.798501 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4af3162-8ce6-4497-99ef-823e2be126f7 req-004a4b6a-1a97-4d0e-8847-112f7af1f224 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:37.799955 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f4af3162-8ce6-4497-99ef-823e2be126f7 req-004a4b6a-1a97-4d0e-8847-112f7af1f224 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0483105 Dec 08 11:35:37.846793 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f4af3162-8ce6-4497-99ef-823e2be126f7 req-a6f557a7-9c2e-472b-a5da-24f50d339c0c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409839 Dec 08 11:35:37.986392 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 req-7e190136-b6e4-422d-9b64-0d33a42e182f service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=96b6dc81-7654-48f5-ac3f-e3e4d35982b3 HTTP/1.1" status: 200 len: 217 time: 0.0326679 Dec 08 11:35:38.041769 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 req-8009d757-a49d-473a-959c-16e0fdd3d7ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:38.043101 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 req-8009d757-a49d-473a-959c-16e0fdd3d7ed service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59ab11c2-3db5-4069-afa6-b6f825d69316 HTTP/1.1" status: 200 len: 859 time: 0.0440934 Dec 08 11:35:38.084456 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 req-1d696cbd-7487-4a66-8a97-71356124b036 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b799b290-99c1-4693-82cc-42bbd4d90adb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0235519 Dec 08 11:35:38.213446 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14238dd6-5f72-4d60-a672-0ac0c32bec69 req-ce45da9a-f917-41fd-aafa-b2af5131c3e4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:38.214893 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-14238dd6-5f72-4d60-a672-0ac0c32bec69 req-ce45da9a-f917-41fd-aafa-b2af5131c3e4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0757053 Dec 08 11:35:38.218472 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 req-dafff6af-049d-4b9f-ba73-28b267dd89fd service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1226852 Dec 08 11:35:38.263822 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-14238dd6-5f72-4d60-a672-0ac0c32bec69 req-3496b1f7-ad57-4e15-8cd0-37770d743f4d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415189 Dec 08 11:35:38.539763 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed7d9ef-45b5-4c58-960a-241c130481ec req-c95215e1-8335-4db7-973a-2e8cf4693973 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:38.541128 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eed7d9ef-45b5-4c58-960a-241c130481ec req-c95215e1-8335-4db7-973a-2e8cf4693973 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0473511 Dec 08 11:35:38.586515 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eed7d9ef-45b5-4c58-960a-241c130481ec req-a3ae6d85-9f23-49c4-a77d-db9cda7d60f3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393848 Dec 08 11:35:38.961012 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a90036-b9e6-4e5c-ac79-5233229e11bc req-ca738fed-aca1-4ec7-a3c1-5b7d75f699dc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:38.962487 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-95a90036-b9e6-4e5c-ac79-5233229e11bc req-ca738fed-aca1-4ec7-a3c1-5b7d75f699dc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0506916 Dec 08 11:35:39.235092 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-95a90036-b9e6-4e5c-ac79-5233229e11bc req-2003708c-b35a-41cc-904f-07e383815799 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2666283 Dec 08 11:35:39.382588 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9563a2f5-4570-46e9-9a49-315060af12a6 req-c53d013f-54dc-4115-87f1-6fde8b2495a9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:39.384041 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9563a2f5-4570-46e9-9a49-315060af12a6 req-c53d013f-54dc-4115-87f1-6fde8b2495a9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0495522 Dec 08 11:35:39.429900 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9563a2f5-4570-46e9-9a49-315060af12a6 req-60f202e1-3053-426b-b0a3-900563632ba3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399573 Dec 08 11:35:39.588383 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-81b2885a-1ee5-46d8-a812-aa4e2c7bb4a6 req-1ec00857-41ca-4050-ac99-8805029e08bb service neutron] 10.222.0.61 "GET /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0816193 Dec 08 11:35:39.710278 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dab2f270-dc4f-4a9d-b1c1-5650affa4faa req-3b58805d-9d47-4cdb-9bbd-6ca6f29c0a49 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:39.711983 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dab2f270-dc4f-4a9d-b1c1-5650affa4faa req-3b58805d-9d47-4cdb-9bbd-6ca6f29c0a49 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0484867 Dec 08 11:35:39.757922 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dab2f270-dc4f-4a9d-b1c1-5650affa4faa req-0e0703ca-b76a-495b-9415-149e74f3f513 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398641 Dec 08 11:35:40.348625 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb2ada73-7049-4f60-927b-cd67c17611c2 req-36fac334-a093-4dce-8791-be4d69e8f2ca tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:40.350036 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cb2ada73-7049-4f60-927b-cd67c17611c2 req-36fac334-a093-4dce-8791-be4d69e8f2ca tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0473454 Dec 08 11:35:40.402652 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cb2ada73-7049-4f60-927b-cd67c17611c2 req-33efc672-aaa6-4b19-83fa-04bc3e8719fd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465534 Dec 08 11:35:40.545430 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-795c249b-0b81-4c46-ad2a-4de142b04df8 req-fb18ca13-6ed2-46ff-b1fc-a64cf9aaf450 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:40.546872 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-795c249b-0b81-4c46-ad2a-4de142b04df8 req-fb18ca13-6ed2-46ff-b1fc-a64cf9aaf450 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0476308 Dec 08 11:35:40.592888 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-795c249b-0b81-4c46-ad2a-4de142b04df8 req-9aa4658e-bf6a-49fd-a42b-4b81f47f2a2e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395508 Dec 08 11:35:40.871018 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82717343-e14e-4df3-afce-fda5f9cf0645 req-14bc52d7-f21f-4a2d-bbdd-f26d8799c092 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:40.872373 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-82717343-e14e-4df3-afce-fda5f9cf0645 req-14bc52d7-f21f-4a2d-bbdd-f26d8799c092 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0473540 Dec 08 11:35:40.918334 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-82717343-e14e-4df3-afce-fda5f9cf0645 req-596771b3-a4ad-45c3-b072-a832e80845d4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402222 Dec 08 11:35:41.515048 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32b46ab2-42fa-4652-9a56-d61cb8f4f288 req-6e0833ca-db25-4b0a-818e-a249cdeb7389 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:41.516481 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-32b46ab2-42fa-4652-9a56-d61cb8f4f288 req-6e0833ca-db25-4b0a-818e-a249cdeb7389 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0498483 Dec 08 11:35:41.564249 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-32b46ab2-42fa-4652-9a56-d61cb8f4f288 req-3647454f-6244-4340-bda2-af498a0992df tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410333 Dec 08 11:35:41.709953 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac87b087-bccd-42ae-ab33-08b76b0f57c6 req-7f4a227f-f22c-40d1-98ec-53996c16e888 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:41.711406 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ac87b087-bccd-42ae-ab33-08b76b0f57c6 req-7f4a227f-f22c-40d1-98ec-53996c16e888 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0479555 Dec 08 11:35:41.756576 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ac87b087-bccd-42ae-ab33-08b76b0f57c6 req-eb317093-7866-44d6-bb12-3b18501e5f10 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394018 Dec 08 11:35:42.030248 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d979bb8-2570-466d-850a-abeaac11deb2 req-57ab71d3-4c13-4a78-a7d0-5c6e48e65d8f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:42.031693 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3d979bb8-2570-466d-850a-abeaac11deb2 req-57ab71d3-4c13-4a78-a7d0-5c6e48e65d8f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0475776 Dec 08 11:35:42.080329 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3d979bb8-2570-466d-850a-abeaac11deb2 req-9b860e13-0fce-409e-927b-0b7010ff8095 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420792 Dec 08 11:35:42.675593 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88d5f412-ec50-40b6-b0c6-0ed27efa1dd3 req-4e86512d-e8f5-4370-8d41-718d48e312fc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:42.677083 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-88d5f412-ec50-40b6-b0c6-0ed27efa1dd3 req-4e86512d-e8f5-4370-8d41-718d48e312fc tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0480881 Dec 08 11:35:42.724553 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-88d5f412-ec50-40b6-b0c6-0ed27efa1dd3 req-85aac3b5-f711-4f63-9ccb-6033a4786384 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415785 Dec 08 11:35:42.874434 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d929d5e5-680b-480a-b78d-b1f40a224377 req-f97c86f2-f79b-44c0-bd31-312af6519834 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:42.875780 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d929d5e5-680b-480a-b78d-b1f40a224377 req-f97c86f2-f79b-44c0-bd31-312af6519834 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.0476274 Dec 08 11:35:42.920759 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d929d5e5-680b-480a-b78d-b1f40a224377 req-69e00e7e-648b-4290-a147-80732f0b75da tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384517 Dec 08 11:35:43.196838 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f08a320-dd3b-46e5-9299-212c9ec7cf03 req-a657edc6-6d9d-43d7-bd36-c1b6de72db71 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:43.198226 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8f08a320-dd3b-46e5-9299-212c9ec7cf03 req-a657edc6-6d9d-43d7-bd36-c1b6de72db71 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0514386 Dec 08 11:35:43.243972 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8f08a320-dd3b-46e5-9299-212c9ec7cf03 req-6ee2f1a7-1828-47de-b70f-e10108882bcd tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398960 Dec 08 11:35:43.630879 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-7dffb2ce-75f5-4c3c-98d2-7b46fd76bf45 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:43.632355 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-7dffb2ce-75f5-4c3c-98d2-7b46fd76bf45 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/networks?id=a19166f1-a36a-4f08-8a61-f4d3fa1e8383 HTTP/1.1" status: 200 len: 814 time: 0.1315129 Dec 08 11:35:43.635147 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dd9e97-a016-4429-9128-2bc6446760c4 req-8cfeb13e-e029-42e7-862d-e239aea9b19d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:43.636496 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e7dd9e97-a016-4429-9128-2bc6446760c4 req-8cfeb13e-e029-42e7-862d-e239aea9b19d service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 1099 time: 0.0752153 Dec 08 11:35:43.647994 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-68819aaa-b5b8-4e71-b4fd-676747c5c78a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/quotas/b1b41ae149164acbb31b021c9049b500 HTTP/1.1" status: 200 len: 375 time: 0.0096059 Dec 08 11:35:43.717779 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-91137331-799e-420d-b90a-a78530201892 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=b1b41ae149164acbb31b021c9049b500&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0594075 Dec 08 11:35:43.809316 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dd9e97-a016-4429-9128-2bc6446760c4 req-c970a2f9-c6ff-435f-9bdf-77da44873d48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:43.810867 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e7dd9e97-a016-4429-9128-2bc6446760c4 req-c970a2f9-c6ff-435f-9bdf-77da44873d48 service neutron] 10.222.0.61 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 917 time: 0.1594663 Dec 08 11:35:43.879701 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-306a04a6-a294-42bf-98e7-85cface1ee96 service neutron] 10.222.0.66 "GET /v2.0/networks/a19166f1-a36a-4f08-8a61-f4d3fa1e8383?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1515474 Dec 08 11:35:43.960569 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e7dd9e97-a016-4429-9128-2bc6446760c4 req-5e7dabcd-9f85-43da-8009-5f8ae7c85f7f service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe HTTP/1.1" status: 200 len: 1001 time: 0.1384668 Dec 08 11:35:44.026747 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-081fde80-e026-4f4f-b52a-990bcdb5e963 req-b8a0fa14-d1ba-4e8c-942a-ba3873f332b3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:44.028222 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-081fde80-e026-4f4f-b52a-990bcdb5e963 req-b8a0fa14-d1ba-4e8c-942a-ba3873f332b3 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.1438539 Dec 08 11:35:44.070504 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dd9e97-a016-4429-9128-2bc6446760c4 req-125097d5-c213-4fec-a2cb-a4f93e7b9c27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:44.071906 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e7dd9e97-a016-4429-9128-2bc6446760c4 req-125097d5-c213-4fec-a2cb-a4f93e7b9c27 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 200 len: 855 time: 0.0985806 Dec 08 11:35:44.075363 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-86206856-dbf4-4fc8-b566-953d625d8da2 service neutron] 10.222.0.66 "GET /v2.0/networks/a19166f1-a36a-4f08-8a61-f4d3fa1e8383?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1876264 Dec 08 11:35:44.126374 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-081fde80-e026-4f4f-b52a-990bcdb5e963 req-890ce7ac-b244-484c-8bac-60501d2cabae tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0906181 Dec 08 11:35:44.145084 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7dd9e97-a016-4429-9128-2bc6446760c4 req-6a00517b-6d1a-48e3-889f-39fcc5b5f44d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:44.147166 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e7dd9e97-a016-4429-9128-2bc6446760c4 req-6a00517b-6d1a-48e3-889f-39fcc5b5f44d service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=fd37a1fc-3614-462b-92a2-b41260c949a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0597754 Dec 08 11:35:44.289510 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-14710c50-eebd-4e14-a160-dda941ff5f21 req-371d0785-2bed-488c-8ad0-48e8b003bb8f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 210 time: 0.0454752 Dec 08 11:35:44.317368 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c19c23-91cc-4e64-a4fd-04b64cedf747 req-d2f69237-2d97-4b09-8058-1cb9dd704e36 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:44.319034 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-52c19c23-91cc-4e64-a4fd-04b64cedf747 req-d2f69237-2d97-4b09-8058-1cb9dd704e36 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.1228223 Dec 08 11:35:44.364684 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e7dd9e97-a016-4429-9128-2bc6446760c4 req-0786fcd5-21c8-4298-9f71-49e5269d27ab service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1904027 Dec 08 11:35:44.461196 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-52c19c23-91cc-4e64-a4fd-04b64cedf747 req-01035e10-90e6-4b59-974f-1041f42fa7e6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1330700 Dec 08 11:35:44.499032 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e457ae4a-2f90-4ac1-bfdb-c1e76f8c0cfd req-33b99112-a7de-4f55-b0e4-e2b2e2835994 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:44.500513 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e457ae4a-2f90-4ac1-bfdb-c1e76f8c0cfd req-33b99112-a7de-4f55-b0e4-e2b2e2835994 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.1250751 Dec 08 11:35:44.523277 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e7dd9e97-a016-4429-9128-2bc6446760c4 req-6ad57fae-0dfd-4d4f-9214-0c0d54f77372 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1489851 Dec 08 11:35:44.565788 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e457ae4a-2f90-4ac1-bfdb-c1e76f8c0cfd req-6d3c2c10-2842-4308-92be-0392aa4172fa tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534112 Dec 08 11:35:45.239943 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec024138-8abe-4785-a51d-e0e8a57fa465 req-51397fae-efe1-4a97-8b27-f961b82d2997 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:45.241468 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ec024138-8abe-4785-a51d-e0e8a57fa465 req-51397fae-efe1-4a97-8b27-f961b82d2997 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0496173 Dec 08 11:35:45.300979 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ec024138-8abe-4785-a51d-e0e8a57fa465 req-b43817e0-a151-43a4-98f6-24c3630cafa2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0530672 Dec 08 11:35:45.411538 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-54a5b580-99e9-4126-acf0-2e48b94fdaab req-b5cf9aef-0bb7-43bc-abdb-43c02dfecf56 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 210 time: 0.0440271 Dec 08 11:35:45.448922 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-7a7ca181-56f3-439b-a6b1-ebe249c38485 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:45.450387 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-7a7ca181-56f3-439b-a6b1-ebe249c38485 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.61 "GET /v2.0/networks?id=a19166f1-a36a-4f08-8a61-f4d3fa1e8383 HTTP/1.1" status: 200 len: 814 time: 0.1615407 Dec 08 11:35:45.468881 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5322ad00-f08a-4cd6-a99c-fef8632c6516 req-7a249ebc-183e-40b7-bd2f-c6a4721f7d57 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:45.470356 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5322ad00-f08a-4cd6-a99c-fef8632c6516 req-7a249ebc-183e-40b7-bd2f-c6a4721f7d57 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0915549 Dec 08 11:35:45.474899 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Request body: {'port': {'device_id': '87e72067-7d43-45ee-9f67-e4a72419ea29', 'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383', 'admin_state_up': True, 'tenant_id': 'b1b41ae149164acbb31b021c9049b500'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:35:45.613484 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5322ad00-f08a-4cd6-a99c-fef8632c6516 req-37a2688e-22fd-43a4-9f13-89d528519a2d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1351657 Dec 08 11:35:45.633499 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed2a11f0-9753-4c60-bc63-c1c843f98204 req-9a7cc129-4f81-4c55-aee0-c81d830442b7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:45.634869 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 54722) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:35:45.635399 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ed2a11f0-9753-4c60-bc63-c1c843f98204 req-9a7cc129-4f81-4c55-aee0-c81d830442b7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 946 time: 0.1010687 Dec 08 11:35:45.704942 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Made reservation on behalf of b1b41ae149164acbb31b021c9049b500 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:35:45.708266 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:45.749195 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ed2a11f0-9753-4c60-bc63-c1c843f98204 req-4f196d46-7387-42c3-a680-608a5021ca3d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0971816 Dec 08 11:35:45.808968 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb60cb17-b7b0-49f0-8052-92707b66387f req-d0f181e1-ea4f-4c16-831e-e365c0f0fee6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:45.810509 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eb60cb17-b7b0-49f0-8052-92707b66387f req-d0f181e1-ea4f-4c16-831e-e365c0f0fee6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.1280086 Dec 08 11:35:45.835988 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-045e7b44-c44a-4da7-84ad-289d17747fd4 tempest-TestShelveInstance-537382822 tempest-TestShelveInstance-537382822-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:45.837572 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-045e7b44-c44a-4da7-84ad-289d17747fd4 tempest-TestShelveInstance-537382822 tempest-TestShelveInstance-537382822-project-admin] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 1093 time: 0.2004721 Dec 08 11:35:45.840386 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 54728) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:35:45.844626 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Request body: {'floatingip': {'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'port_id': '79e98205-d459-4886-827e-71b058999e30', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'fixed_ip_address': '172.20.0.5'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:35:45.866732 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for floatingip, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:45.903027 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eb60cb17-b7b0-49f0-8052-92707b66387f req-ad6290ef-9a6c-49a6-8e37-a6a5ec21312b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853066 Dec 08 11:35:45.912232 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Allocated IP 172.20.0.13 (a19166f1-a36a-4f08-8a61-f4d3fa1e8383/095735e3-fae9-450c-a1b3-5a4932e6f812/a6ac8770-1fec-45c1-8b57-a96317ee73ed) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:35:45.978080 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.072048 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.093609 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Allocated IP 172.27.2.165 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/790bdda3-34e1-4e3c-abe5-d7f5a06d21a4) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:35:46.106605 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.148313 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Network a19166f1-a36a-4f08-8a61-f4d3fa1e8383 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:35:46.151825 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:35:46.154444 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:35:46.189249 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Pushing event updated for resources: {'Port': ['ID=a6ac8770-1fec-45c1-8b57-a96317ee73ed,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:46.194327 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.202045 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.202401 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.202751 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.203094 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.203435 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.203771 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.204107 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.204438 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.204772 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.205100 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.206005 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.206339 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.206666 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.227416 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:46.227994 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.229359 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.243909 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-f85deba4-c86e-48e4-b730-2e98ca4313bc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7725749 Dec 08 11:35:46.267167 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:35:46.272901 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:35:46.276513 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:35:46.281795 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Pushing event updated for resources: {'Port': ['ID=790bdda3-34e1-4e3c-abe5-d7f5a06d21a4,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:46.308517 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.308864 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.309235 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.309573 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.309906 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.310233 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.310558 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.310880 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.311205 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.311527 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.311850 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.312170 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.312487 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:35:46.327078 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Request body: {'port': {'device_id': '87e72067-7d43-45ee-9f67-e4a72419ea29', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:35:46.368641 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:35:46.381034 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.448204 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.481274 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:46.482580 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:35:46.484952 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7b283391-0062-465a-ac1d-fd15b97b220b" -d '{"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-unplugged", "status": "completed", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:35:46.494619 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.527242 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Wed, 08 Dec 2021 11:35:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34b8a949-893a-406d-b5eb-efed8505afaa x-openstack-request-id: req-34b8a949-893a-406d-b5eb-efed8505afaa {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:35:46.527561 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-unplugged", "status": "completed", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:35:46.527822 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-34b8a949-893a-406d-b5eb-efed8505afaa {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:35:46.528269 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'code': 200} Dec 08 11:35:46.559462 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,revision_number=8']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:46.617779 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e66e8bc2-02d9-4321-a647-560ddbfffc0d req-a523883a-bdfc-4512-9a1b-27cac1b83765 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:46.619210 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e66e8bc2-02d9-4321-a647-560ddbfffc0d req-a523883a-bdfc-4512-9a1b-27cac1b83765 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 932 time: 0.1002724 Dec 08 11:35:46.680944 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.708330 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e66e8bc2-02d9-4321-a647-560ddbfffc0d req-6b7e7a71-df18-4f6a-afc3-9af6fa97e420 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0807877 Dec 08 11:35:46.745346 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a6ac8770-1fec-45c1-8b57-a96317ee73ed {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:35:46.749059 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.753336 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.765554 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Transition to ACTIVE for port object a6ac8770-1fec-45c1-8b57-a96317ee73ed will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:35:46.769557 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.821566 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Pushing event updated for resources: {'Port': ['ID=a6ac8770-1fec-45c1-8b57-a96317ee73ed,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:46.912917 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.916659 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00a96e00-8749-494d-b90b-b9ca64db9ef2 req-16949b95-30e8-4ffa-89e9-49033e9d2919 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:46.918431 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-00a96e00-8749-494d-b90b-b9ca64db9ef2 req-16949b95-30e8-4ffa-89e9-49033e9d2919 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0931010 Dec 08 11:35:46.918599 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5648421'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:46.932000 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Attempting to bind port a6ac8770-1fec-45c1-8b57-a96317ee73ed on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:35:46.932344 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Attempting to bind port a6ac8770-1fec-45c1-8b57-a96317ee73ed by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': '93ea5ca7-22ef-4002-8579-aa09922044a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 269, 'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:35:46.932680 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Attempting to bind port a6ac8770-1fec-45c1-8b57-a96317ee73ed on network a19166f1-a36a-4f08-8a61-f4d3fa1e8383 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:35:46.945786 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Port a6ac8770-1fec-45c1-8b57-a96317ee73ed on network a19166f1-a36a-4f08-8a61-f4d3fa1e8383 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:35:46.946128 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Attempting to bind port a6ac8770-1fec-45c1-8b57-a96317ee73ed on network a19166f1-a36a-4f08-8a61-f4d3fa1e8383 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:35:46.960999 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 35, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:35:46.961894 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Checking segment: {'id': '93ea5ca7-22ef-4002-8579-aa09922044a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 269, 'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:35:46.961894 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Bound using segment: {'id': '93ea5ca7-22ef-4002-8579-aa09922044a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 269, 'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:35:46.962179 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Bound port: a6ac8770-1fec-45c1-8b57-a96317ee73ed, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '93ea5ca7-22ef-4002-8579-aa09922044a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 269, 'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:35:46.962537 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:47.005531 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Pushing event updated for resources: {'Port': ['ID=790bdda3-34e1-4e3c-abe5-d7f5a06d21a4,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:47.032522 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:47.078033 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-00a96e00-8749-494d-b90b-b9ca64db9ef2 req-df07e7d4-ffbf-46f6-a62f-5b399b98fd18 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1429462 Dec 08 11:35:47.134813 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64dc5f51-ec19-43d2-b760-f2f0af453721 req-855ccf23-344c-4539-bf4a-f739965bdfe5 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:47.137354 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-64dc5f51-ec19-43d2-b760-f2f0af453721 req-855ccf23-344c-4539-bf4a-f739965bdfe5 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.1543043 Dec 08 11:35:47.183759 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.l3_db [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Floating IP b9d41293-de2e-446d-89e7-d15c0bf1293e associated. External IP: 172.27.2.165, port: 79e98205-d459-4886-827e-71b058999e30. Dec 08 11:35:47.184979 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] For port a6ac8770-1fec-45c1-8b57-a96317ee73ed, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:35:47.208290 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] For port a6ac8770-1fec-45c1-8b57-a96317ee73ed, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=a6ac8770-1fec-45c1-8b57-a96317ee73ed,segment=NetworkSegment(93ea5ca7-22ef-4002-8579-aa09922044a7),segment_id=93ea5ca7-22ef-4002-8579-aa09922044a7)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:35:47.213929 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:47.244397 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-64dc5f51-ec19-43d2-b760-f2f0af453721 req-7b60b525-3d1d-4802-b963-edb9a6a98cc4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0962207 Dec 08 11:35:47.262255 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:47.262782 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:47.264146 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] 10.222.0.61 "PUT /v2.0/ports/a6ac8770-1fec-45c1-8b57-a96317ee73ed HTTP/1.1" status: 200 len: 1094 time: 0.9412901 Dec 08 11:35:47.264594 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '87e72067-7d43-45ee-9f67-e4a72419ea29', 'tag': 'a6ac8770-1fec-45c1-8b57-a96317ee73ed'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:35:47.267193 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9c163706-5e2e-467b-803f-a2fa669282e2" -d '{"events": [{"name": "network-changed", "server_uuid": "87e72067-7d43-45ee-9f67-e4a72419ea29", "tag": "a6ac8770-1fec-45c1-8b57-a96317ee73ed"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:35:47.296003 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32fe6dd8-1c89-4b10-8875-d8339c9ca206 service neutron] Pushing event updated for resources: {'Port': ['ID=a6ac8770-1fec-45c1-8b57-a96317ee73ed,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:47.326378 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:35:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2f9eaf5e-8f1c-4045-9750-c2bbf3470c63 x-openstack-request-id: req-2f9eaf5e-8f1c-4045-9750-c2bbf3470c63 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:35:47.326737 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "87e72067-7d43-45ee-9f67-e4a72419ea29", "tag": "a6ac8770-1fec-45c1-8b57-a96317ee73ed", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:35:47.327056 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-2f9eaf5e-8f1c-4045-9750-c2bbf3470c63 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:35:47.327508 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '87e72067-7d43-45ee-9f67-e4a72419ea29', 'tag': 'a6ac8770-1fec-45c1-8b57-a96317ee73ed', 'status': 'completed', 'code': 200} Dec 08 11:35:47.367669 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-02868168-42ed-443f-868a-918f9baf598b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:47.369169 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-02868168-42ed-443f-868a-918f9baf598b service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=b1b41ae149164acbb31b021c9049b500&device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 1097 time: 0.0453248 Dec 08 11:35:47.416432 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:35:47.417853 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-309483ba-39f8-413d-bd6e-ea038c642ba4 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a6ac8770-1fec-45c1-8b57-a96317ee73ed HTTP/1.1" status: 200 len: 217 time: 0.0376103 Dec 08 11:35:47.470520 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-c3abc2d0-7635-49c0-81ad-b983c2441206 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:47.472653 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-c3abc2d0-7635-49c0-81ad-b983c2441206 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=095735e3-fae9-450c-a1b3-5a4932e6f812 HTTP/1.1" status: 200 len: 854 time: 0.0441666 Dec 08 11:35:47.504448 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-28ea6004-3088-4634-a9e0-faab789ea350 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=a19166f1-a36a-4f08-8a61-f4d3fa1e8383&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0235410 Dec 08 11:35:47.549774 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:47.610375 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-b4e473c3-ef45-44e2-b154-d55d1aeb2b6f service neutron] 10.222.0.61 "GET /v2.0/networks/a19166f1-a36a-4f08-8a61-f4d3fa1e8383?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0889928 Dec 08 11:35:47.697592 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:35:47.713704 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01a40b75-df01-4611-b55e-df7e7b3fff06 None None] Sync routers for ids ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:35:47.719479 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:47.723944 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72e29fa0-0302-4aa4-9d49-5ae62c0a81a7 req-4e02bcf9-c9ae-4a18-a48f-e0d765fd1fe2 service neutron] 10.222.0.61 "GET /v2.0/networks/a19166f1-a36a-4f08-8a61-f4d3fa1e8383?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1003423 Dec 08 11:35:47.724598 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01a40b75-df01-4611-b55e-df7e7b3fff06 None None] Routers {'3a9d62c0-7438-4191-89d6-70be7d9ccc6c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:35:47.725342 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-01a40b75-df01-4611-b55e-df7e7b3fff06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:35:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:35:47.754597 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-ff5cf25f-aa0a-4710-bef4-12dce356396f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.9130774 Dec 08 11:35:47.755425 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'tag': '79e98205-d459-4886-827e-71b058999e30'}] {{(pid=102317) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:35:47.758823 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}212dae370a2b559de5b7d578af79073c1e0f4cb02126db35c6693ef88f95633e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175" -d '{"events": [{"name": "network-changed", "server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "tag": "79e98205-d459-4886-827e-71b058999e30"}]}' {{(pid=102317) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:35:47.807853 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:35:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5b365461-3315-4625-898a-83d50ee1a280 x-openstack-request-id: req-5b365461-3315-4625-898a-83d50ee1a280 {{(pid=102317) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:35:47.808151 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "tag": "79e98205-d459-4886-827e-71b058999e30", "status": "completed", "code": 200}]} {{(pid=102317) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:35:47.808413 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-5b365461-3315-4625-898a-83d50ee1a280 {{(pid=102317) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:35:47.808810 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'tag': '79e98205-d459-4886-827e-71b058999e30', 'status': 'completed', 'code': 200} Dec 08 11:35:47.864464 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-01a40b75-df01-4611-b55e-df7e7b3fff06 None None] Set router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:35:48.093831 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-01a40b75-df01-4611-b55e-df7e7b3fff06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:44Z', 'revision_number': 4, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port': {'id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:93:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 352, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'b9d41293-de2e-446d-89e7-d15c0bf1293e', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'floating_ip_address': '172.27.2.165', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'port_id': '79e98205-d459-4886-827e-71b058999e30', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 401, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'mac_address': 'fa:16:3e:dd:98:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:35:46Z', 'updated_at': '2021-12-08T11:35:46Z', 'revision_number': 0, 'project_id': '23027f58b51142389f64405702a0fcd3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd5964107-ee0c-4bb0-ad4c-8179b4fa75a2', 'name': '', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'mac_address': 'fa:16:3e:a3:c7:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 353, 'fixed_ips': [{'subnet_id': '59081569-032b-42c0-afce-26c79ceb7aac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:44Z', 'updated_at': '2021-12-08T11:33:50Z', 'revision_number': 5, 'project_id': '23027f58b51142389f64405702a0fcd3', 'subnets': [{'id': '59081569-032b-42c0-afce-26c79ceb7aac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:35:48.123075 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01a40b75-df01-4611-b55e-df7e7b3fff06 None None] Checking router: 3a9d62c0-7438-4191-89d6-70be7d9ccc6c for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:35:48.131965 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-c122f49e-426b-4a1f-8192-15a3ff95bc20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:48.132570 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01a40b75-df01-4611-b55e-df7e7b3fff06 None None] Routers {'3a9d62c0-7438-4191-89d6-70be7d9ccc6c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:35:48.133298 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-01a40b75-df01-4611-b55e-df7e7b3fff06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:35:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:35:48.133501 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-c122f49e-426b-4a1f-8192-15a3ff95bc20 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=b1b41ae149164acbb31b021c9049b500&device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 1097 time: 0.3397732 Dec 08 11:35:48.149440 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d27c46-2d4d-4567-b7fb-fc8fb64d9a7a req-fdc47c68-bbd7-40c9-ac4c-405e12352353 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:48.150665 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-79d27c46-2d4d-4567-b7fb-fc8fb64d9a7a req-fdc47c68-bbd7-40c9-ac4c-405e12352353 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 944 time: 0.3297923 Dec 08 11:35:48.165223 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-b246621b-10be-4a04-8727-5327d271ccbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:48.166654 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-b246621b-10be-4a04-8727-5327d271ccbf service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=23027f58b51142389f64405702a0fcd3&device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 1098 time: 0.0813041 Dec 08 11:35:48.241380 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-01a40b75-df01-4611-b55e-df7e7b3fff06 None None] Set router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:35:48.362967 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-79d27c46-2d4d-4567-b7fb-fc8fb64d9a7a req-f399f74a-429a-4b9d-88ad-5002566533c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2007256 Dec 08 11:35:48.373863 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6352b75c-8cbf-4307-9544-36e97a31e8b4 req-c18ba2d0-9fb9-483f-a1b2-f1af7a7a70a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:48.375241 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6352b75c-8cbf-4307-9544-36e97a31e8b4 req-c18ba2d0-9fb9-483f-a1b2-f1af7a7a70a6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.1584694 Dec 08 11:35:48.384995 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-6c3b8b58-332b-4172-9e39-01d25b72652e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:48.386473 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-6c3b8b58-332b-4172-9e39-01d25b72652e service neutron] 10.222.0.61 "GET /v2.0/networks?id=a19166f1-a36a-4f08-8a61-f4d3fa1e8383 HTTP/1.1" status: 200 len: 915 time: 0.2325871 Dec 08 11:35:48.441355 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-e5b9915e-e072-4c5b-8194-414bcbcdd405 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:48.442773 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-e5b9915e-e072-4c5b-8194-414bcbcdd405 service neutron] 10.222.0.61 "GET /v2.0/networks?id=55a129bc-8ce3-4aac-98fb-64f16c4a4949 HTTP/1.1" status: 200 len: 910 time: 0.2613392 Dec 08 11:35:48.449770 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-98ce5bbd-9060-4e6a-ae7a-40b09a336a09 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a6ac8770-1fec-45c1-8b57-a96317ee73ed HTTP/1.1" status: 200 len: 217 time: 0.0526557 Dec 08 11:35:48.475047 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-01a40b75-df01-4611-b55e-df7e7b3fff06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:44Z', 'revision_number': 4, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port': {'id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:93:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 352, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'b9d41293-de2e-446d-89e7-d15c0bf1293e', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'floating_ip_address': '172.27.2.165', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'port_id': '79e98205-d459-4886-827e-71b058999e30', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 401, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'mac_address': 'fa:16:3e:dd:98:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:35:46Z', 'updated_at': '2021-12-08T11:35:46Z', 'revision_number': 0, 'project_id': '23027f58b51142389f64405702a0fcd3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd5964107-ee0c-4bb0-ad4c-8179b4fa75a2', 'name': '', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'mac_address': 'fa:16:3e:a3:c7:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 353, 'fixed_ips': [{'subnet_id': '59081569-032b-42c0-afce-26c79ceb7aac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:44Z', 'updated_at': '2021-12-08T11:33:50Z', 'revision_number': 5, 'project_id': '23027f58b51142389f64405702a0fcd3', 'subnets': [{'id': '59081569-032b-42c0-afce-26c79ceb7aac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:35:48.500994 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-01a40b75-df01-4611-b55e-df7e7b3fff06 None None] The sync data for ids ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'] in dv-cinder-819778-3-iscsi is: [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:44Z', 'revision_number': 4, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port': {'id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:93:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 352, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'b9d41293-de2e-446d-89e7-d15c0bf1293e', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'floating_ip_address': '172.27.2.165', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'port_id': '79e98205-d459-4886-827e-71b058999e30', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 401, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'mac_address': 'fa:16:3e:dd:98:56', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:35:46Z', 'updated_at': '2021-12-08T11:35:46Z', 'revision_number': 0, 'project_id': '23027f58b51142389f64405702a0fcd3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd5964107-ee0c-4bb0-ad4c-8179b4fa75a2', 'name': '', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'mac_address': 'fa:16:3e:a3:c7:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 353, 'fixed_ips': [{'subnet_id': '59081569-032b-42c0-afce-26c79ceb7aac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:44Z', 'updated_at': '2021-12-08T11:33:50Z', 'revision_number': 5, 'project_id': '23027f58b51142389f64405702a0fcd3', 'subnets': [{'id': '59081569-032b-42c0-afce-26c79ceb7aac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:35:48.599665 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6352b75c-8cbf-4307-9544-36e97a31e8b4 req-b0a15780-7882-439b-8e0b-979b9bf9b26f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2013407 Dec 08 11:35:48.602213 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-ddb721ba-b52b-4c54-bf96-0b3b763e369f service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=79e98205-d459-4886-827e-71b058999e30 HTTP/1.1" status: 200 len: 999 time: 0.1516395 Dec 08 11:35:48.614848 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3f57ad7-2507-4c79-8b6b-6f830673cdbf req-429ef07d-48f8-4364-8b0d-f73ad28be2db tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:48.616288 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d3f57ad7-2507-4c79-8b6b-6f830673cdbf req-429ef07d-48f8-4364-8b0d-f73ad28be2db tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.1765404 Dec 08 11:35:48.617846 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-bbd6bd44-c9cf-4bed-a85e-149436a3c7db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:48.619048 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-bbd6bd44-c9cf-4bed-a85e-149436a3c7db service neutron] 10.222.0.61 "GET /v2.0/subnets?id=095735e3-fae9-450c-a1b3-5a4932e6f812 HTTP/1.1" status: 200 len: 854 time: 0.1524596 Dec 08 11:35:48.686732 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-53aca72a-34bc-41ea-9e55-e7c796b1b824 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=a19166f1-a36a-4f08-8a61-f4d3fa1e8383&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0526118 Dec 08 11:35:48.736954 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fad004f0-a68f-4ec5-9413-fded509993ac None None] New status for floating IP b9d41293-de2e-446d-89e7-d15c0bf1293e: ACTIVE {{(pid=102319) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:35:48.763995 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-b6e2efb4-b936-48c2-a17f-d24733479999 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:48.765488 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-b6e2efb4-b936-48c2-a17f-d24733479999 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59081569-032b-42c0-afce-26c79ceb7aac HTTP/1.1" status: 200 len: 848 time: 0.1455691 Dec 08 11:35:48.778346 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d3f57ad7-2507-4c79-8b6b-6f830673cdbf req-b2811c79-b1e2-4519-a2b7-9735466b4746 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1514337 Dec 08 11:35:48.848474 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-50bb1692-1244-4055-8cf8-518d8e6640ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:48.859083 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-50bb1692-1244-4055-8cf8-518d8e6640ee service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=55a129bc-8ce3-4aac-98fb-64f16c4a4949&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0708499 Dec 08 11:35:48.859083 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-b52bc5ab-3fe1-4eaa-902b-db98e7632957 service neutron] 10.222.0.61 "GET /v2.0/networks/a19166f1-a36a-4f08-8a61-f4d3fa1e8383?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1556995 Dec 08 11:35:49.046276 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-daf599ff-4106-4ea6-bbe9-9ce147c66bdb service neutron] 10.222.0.61 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1607854 Dec 08 11:35:49.049834 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9c163706-5e2e-467b-803f-a2fa669282e2 req-d2db303c-175f-421c-844e-4999739fa844 service neutron] 10.222.0.61 "GET /v2.0/networks/a19166f1-a36a-4f08-8a61-f4d3fa1e8383?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1631386 Dec 08 11:35:49.173567 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2f6e50c4-d2ce-4bd9-9d6d-3e7ecefb9175 req-544ca76d-daa4-410a-b242-6488c0b7b8c8 service neutron] 10.222.0.61 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1067550 Dec 08 11:35:49.180389 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [req-0160b20b-9c33-4ec4-b446-013031c59cc1 req-04562e2e-3de7-4295-8dfb-4bada09461f6 service neutron] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102318) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:35:49.181360 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0160b20b-9c33-4ec4-b446-013031c59cc1 req-04562e2e-3de7-4295-8dfb-4bada09461f6 service neutron] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0051024 Dec 08 11:35:49.348965 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b728f510-886a-4343-adf8-ab7814bbc50c req-10b35fad-0140-4a8c-8814-f016376eac66 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:49.350483 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b728f510-886a-4343-adf8-ab7814bbc50c req-10b35fad-0140-4a8c-8814-f016376eac66 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0495019 Dec 08 11:35:49.399491 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b728f510-886a-4343-adf8-ab7814bbc50c req-a9e1cbcf-1bb8-4a54-b40d-1d05483fb6ca tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422719 Dec 08 11:35:49.483517 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf1f43b2-faf0-48c5-8f21-4d26fc608ec1 req-a8833d8b-e845-4d03-a10a-0c2d00ae78d2 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:49.485355 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bf1f43b2-faf0-48c5-8f21-4d26fc608ec1 req-a8833d8b-e845-4d03-a10a-0c2d00ae78d2 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 944 time: 0.0474544 Dec 08 11:35:49.537438 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bf1f43b2-faf0-48c5-8f21-4d26fc608ec1 req-fbc431ff-54f5-46d8-83bb-6178f713b3a1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458500 Dec 08 11:35:49.663709 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 54808) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:35:49.745288 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-de813aca-7c9b-473f-95a9-c933d9d22ef7 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0803597 Dec 08 11:35:49.754468 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-cbe0ca00-89da-45d3-870f-767872daffe7 service neutron] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102318) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:35:49.755421 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-cbe0ca00-89da-45d3-870f-767872daffe7 service neutron] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0053687 Dec 08 11:35:50.520284 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d0181a-4700-4ee0-9b21-c978022ad57a req-325563f0-720d-49b5-bed8-77439357227c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:50.521699 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22d0181a-4700-4ee0-9b21-c978022ad57a req-325563f0-720d-49b5-bed8-77439357227c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0473416 Dec 08 11:35:50.568700 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22d0181a-4700-4ee0-9b21-c978022ad57a req-58ce324c-1395-48ac-9627-22817bdbbb91 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411346 Dec 08 11:35:50.655432 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b6a5c9-b05d-4a5b-95f1-2ff0404aa431 req-ca8daa75-20bd-4371-a81b-5dd9a85ba022 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:50.656883 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8b6a5c9-b05d-4a5b-95f1-2ff0404aa431 req-ca8daa75-20bd-4371-a81b-5dd9a85ba022 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 944 time: 0.0486939 Dec 08 11:35:50.706216 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8b6a5c9-b05d-4a5b-95f1-2ff0404aa431 req-18c2aa83-a0f1-4b78-9faa-f5aab5adece7 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431192 Dec 08 11:35:51.686414 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e52932f-320a-41d0-8b3d-bd6d90971e01 req-a4993717-e57a-4fa7-86e7-728835f78750 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:51.687864 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8e52932f-320a-41d0-8b3d-bd6d90971e01 req-a4993717-e57a-4fa7-86e7-728835f78750 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0481472 Dec 08 11:35:51.733748 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8e52932f-320a-41d0-8b3d-bd6d90971e01 req-13a6ba0f-ed28-43d2-ba06-6d0e56e798dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392120 Dec 08 11:35:51.828075 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73922f64-8a0c-4747-b566-df26ec6ab3db req-95d79077-c5bd-4198-89cb-8a42d3341fcd tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:51.829562 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-73922f64-8a0c-4747-b566-df26ec6ab3db req-95d79077-c5bd-4198-89cb-8a42d3341fcd tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 944 time: 0.0486741 Dec 08 11:35:51.874949 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-73922f64-8a0c-4747-b566-df26ec6ab3db req-815c2f4a-9b46-4bde-8811-38db1f4e5c4a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395136 Dec 08 11:35:52.395550 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device a6ac8770-1fec-45c1-8b57-a96317ee73ed details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:35:52.400011 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:35:52.514243 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-816e79b9-f829-4ce0-a7d2-9a73b48c8848 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:52.576649 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port a6ac8770-1fec-45c1-8b57-a96317ee73ed, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=a6ac8770-1fec-45c1-8b57-a96317ee73ed,segment=NetworkSegment(93ea5ca7-22ef-4002-8579-aa09922044a7),segment_id=93ea5ca7-22ef-4002-8579-aa09922044a7)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:52.588045 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': 'a6ac8770-1fec-45c1-8b57-a96317ee73ed', 'network_id': 'a19166f1-a36a-4f08-8a61-f4d3fa1e8383', 'port_id': 'a6ac8770-1fec-45c1-8b57-a96317ee73ed', 'mac_address': 'fa:16:3e:5e:d0:5f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 269, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '095735e3-fae9-450c-a1b3-5a4932e6f812', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:35:52.628133 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:52.641098 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a6ac8770-1fec-45c1-8b57-a96317ee73ed {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:35:52.661937 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port a6ac8770-1fec-45c1-8b57-a96317ee73ed, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=a6ac8770-1fec-45c1-8b57-a96317ee73ed,segment=NetworkSegment(93ea5ca7-22ef-4002-8579-aa09922044a7),segment_id=93ea5ca7-22ef-4002-8579-aa09922044a7)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:52.666037 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:52.718298 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=a6ac8770-1fec-45c1-8b57-a96317ee73ed,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:52.860779 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cb53db7-3d59-4df1-bedc-716271d3e488 req-0b621b84-8c3a-408e-83ad-00d4b9578938 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:52.862239 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9cb53db7-3d59-4df1-bedc-716271d3e488 req-0b621b84-8c3a-408e-83ad-00d4b9578938 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0526917 Dec 08 11:35:52.909738 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9cb53db7-3d59-4df1-bedc-716271d3e488 req-eb5bf0e9-bfe4-4164-bc27-66a8387a27ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415778 Dec 08 11:35:52.989429 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a5b107-bfb0-42ec-bde9-b9af7e566cb5 req-7be3c0c8-43f5-4e23-81f0-d8c8ca28388e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:52.991092 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-82a5b107-bfb0-42ec-bde9-b9af7e566cb5 req-7be3c0c8-43f5-4e23-81f0-d8c8ca28388e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 945 time: 0.0500429 Dec 08 11:35:53.040564 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-82a5b107-bfb0-42ec-bde9-b9af7e566cb5 req-92004b66-50ad-4d15-a8bb-0012c98a71e9 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434406 Dec 08 11:35:53.303857 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['a6ac8770-1fec-45c1-8b57-a96317ee73ed'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:35:54.096399 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5fc53ad-bc3b-4706-898d-4a2ae96af805 req-92c12a9c-159f-416b-a7be-4ee13b365349 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:54.097995 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f5fc53ad-bc3b-4706-898d-4a2ae96af805 req-92c12a9c-159f-416b-a7be-4ee13b365349 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.1157613 Dec 08 11:35:54.107206 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-f4575b32-5258-4a09-94ef-94435776ace8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:54.108639 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-f4575b32-5258-4a09-94ef-94435776ace8 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f&tenant_id=44406e332fd94f1a9dcd704577410a61 HTTP/1.1" status: 200 len: 1097 time: 0.1008506 Dec 08 11:35:54.213861 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f5fc53ad-bc3b-4706-898d-4a2ae96af805 req-3e2b2688-59a0-40dc-9a77-b082b4c433ca tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1092539 Dec 08 11:35:54.226500 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7bc1821-67f9-4b1f-af28-4df0a618c093 req-4c71abb2-5255-4326-98ba-0f8fa3af66cb tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:54.227993 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c7bc1821-67f9-4b1f-af28-4df0a618c093 req-4c71abb2-5255-4326-98ba-0f8fa3af66cb tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 945 time: 0.1138384 Dec 08 11:35:54.251542 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-79c613e3-7d2f-4801-87d5-ae4f6e007fa6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:54.253127 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-79c613e3-7d2f-4801-87d5-ae4f6e007fa6 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 1097 time: 0.0920601 Dec 08 11:35:54.320412 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c7bc1821-67f9-4b1f-af28-4df0a618c093 req-63beec9e-670d-45ac-bea2-ccd8db8c72ed tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0859575 Dec 08 11:35:54.363439 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-49d43503-f33b-4d91-9d26-8afe21ab9d54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:54.364992 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-49d43503-f33b-4d91-9d26-8afe21ab9d54 service neutron] 10.222.0.61 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 917 time: 0.0996714 Dec 08 11:35:54.432839 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-5d92e59f-94bc-48c1-8c5e-35d9cf30f4b5 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe HTTP/1.1" status: 200 len: 999 time: 0.0584505 Dec 08 11:35:54.499039 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-66071311-793e-4af4-99d1-bf66a1df3c20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:54.500430 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-66071311-793e-4af4-99d1-bf66a1df3c20 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 200 len: 855 time: 0.0417061 Dec 08 11:35:54.555893 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-97c07e7a-caa5-473a-94d9-32b880c4cfa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:54.557525 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-97c07e7a-caa5-473a-94d9-32b880c4cfa4 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=fd37a1fc-3614-462b-92a2-b41260c949a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0431118 Dec 08 11:35:54.661078 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-cae056bc-c3df-42b3-8f40-e25f9b2a5cc3 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847833 Dec 08 11:35:54.691206 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fefd3f69-53f5-4d10-91b3-e7fcc3a786b4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:54.751556 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-604e3ba3-b842-4e30-871b-8cbc12b8cda5 req-999972aa-d2e4-4068-a65b-9e673a5373d2 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827770 Dec 08 11:35:55.360616 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dbe6ae4-826b-4d95-a3a7-6dd425a6ec62 req-14881850-d47d-450a-b633-b7a6de9aab52 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:55.362807 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9dbe6ae4-826b-4d95-a3a7-6dd425a6ec62 req-14881850-d47d-450a-b633-b7a6de9aab52 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0619860 Dec 08 11:35:55.442739 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9dbe6ae4-826b-4d95-a3a7-6dd425a6ec62 req-7d9190d3-913a-457a-9ea2-0450b04f4216 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0736141 Dec 08 11:35:55.472093 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed0729a-166c-4421-9675-0668a30e5671 req-59a1b4ad-1dbd-45b7-be29-22cdf86d4f3e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:55.473900 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1ed0729a-166c-4421-9675-0668a30e5671 req-59a1b4ad-1dbd-45b7-be29-22cdf86d4f3e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 945 time: 0.0734332 Dec 08 11:35:55.526306 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1ed0729a-166c-4421-9675-0668a30e5671 req-ef0655cf-1da5-4d22-bfd9-ff716d08bda2 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439415 Dec 08 11:35:55.776665 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:55.859085 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89c14e3e-521d-4279-b480-0e43ba2cc369 req-a44347d4-6802-4f6b-affc-edac22876fa7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:55.860586 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-89c14e3e-521d-4279-b480-0e43ba2cc369 req-a44347d4-6802-4f6b-affc-edac22876fa7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0517831 Dec 08 11:35:55.909498 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-89c14e3e-521d-4279-b480-0e43ba2cc369 req-c5a32aae-5830-47ce-b679-3334daf8eb8e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426037 Dec 08 11:35:56.273936 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c54d271c-f1b4-4e9f-ba49-cbf4c264a225 req-ee1d9ee1-5be4-4f75-a537-5df814ffac20 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:56.275409 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c54d271c-f1b4-4e9f-ba49-cbf4c264a225 req-ee1d9ee1-5be4-4f75-a537-5df814ffac20 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0493753 Dec 08 11:35:56.322575 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c54d271c-f1b4-4e9f-ba49-cbf4c264a225 req-1c1be1d0-9c5e-42a3-9804-57e409626c05 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412371 Dec 08 11:35:56.413848 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device a6ac8770-1fec-45c1-8b57-a96317ee73ed up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:35:56.477647 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port a6ac8770-1fec-45c1-8b57-a96317ee73ed completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:35:56.481265 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port a6ac8770-1fec-45c1-8b57-a96317ee73ed triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:35:56.481638 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:56.560874 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:56.586494 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '87e72067-7d43-45ee-9f67-e4a72419ea29', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a6ac8770-1fec-45c1-8b57-a96317ee73ed'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:35:56.587910 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7fe4295-3441-4b57-9e68-2dfcb391af16 req-9d6d7bb1-1c03-454c-907f-b29025aa64ee tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:56.589407 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f0b31c98-661e-4573-9fcf-2f20a6d2706a" -d '{"events": [{"server_uuid": "87e72067-7d43-45ee-9f67-e4a72419ea29", "name": "network-vif-plugged", "status": "completed", "tag": "a6ac8770-1fec-45c1-8b57-a96317ee73ed"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:35:56.597241 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c7fe4295-3441-4b57-9e68-2dfcb391af16 req-9d6d7bb1-1c03-454c-907f-b29025aa64ee tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0624382 Dec 08 11:35:56.607182 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port a6ac8770-1fec-45c1-8b57-a96317ee73ed, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=a6ac8770-1fec-45c1-8b57-a96317ee73ed,segment=NetworkSegment(93ea5ca7-22ef-4002-8579-aa09922044a7),segment_id=93ea5ca7-22ef-4002-8579-aa09922044a7)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:35:56.613355 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:56.671298 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=a6ac8770-1fec-45c1-8b57-a96317ee73ed,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:35:56.708800 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c7fe4295-3441-4b57-9e68-2dfcb391af16 req-f44c7595-a44a-4c0d-869f-37bb7e1276a7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1104419 Dec 08 11:35:56.725727 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe5d2ca-331a-4f79-8238-5f6750b52ed7 req-153a8e8e-fa0d-4a8e-8333-84db668cba1d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:56.727470 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1fe5d2ca-331a-4f79-8238-5f6750b52ed7 req-153a8e8e-fa0d-4a8e-8333-84db668cba1d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0953350 Dec 08 11:35:56.762502 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:35:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f49ca51d-a54f-4dae-8765-86f41c157068 x-openstack-request-id: req-f49ca51d-a54f-4dae-8765-86f41c157068 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:35:56.762830 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "87e72067-7d43-45ee-9f67-e4a72419ea29", "name": "network-vif-plugged", "status": "completed", "tag": "a6ac8770-1fec-45c1-8b57-a96317ee73ed", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:35:56.763096 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-f49ca51d-a54f-4dae-8765-86f41c157068 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:35:56.763496 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '87e72067-7d43-45ee-9f67-e4a72419ea29', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a6ac8770-1fec-45c1-8b57-a96317ee73ed', 'code': 200} Dec 08 11:35:56.776904 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1fe5d2ca-331a-4f79-8238-5f6750b52ed7 req-3088cb86-aa57-45e5-85a8-eb857ea4aa36 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424194 Dec 08 11:35:57.034948 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ad5f7a7-60a3-41e6-a795-892f2fb42a0e req-3bd6de23-471c-4512-a8c2-aae280a02496 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:57.036329 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5ad5f7a7-60a3-41e6-a795-892f2fb42a0e req-3bd6de23-471c-4512-a8c2-aae280a02496 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0588620 Dec 08 11:35:57.082175 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5ad5f7a7-60a3-41e6-a795-892f2fb42a0e req-a631352c-692d-4c60-b508-5e84ad7c25c9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399437 Dec 08 11:35:57.133953 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:57.445606 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2538d5-1cfe-4028-a3aa-5bf9b5634a23 req-b8da5425-b5b2-4f4e-96a2-f885538e1c8c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:57.447051 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1f2538d5-1cfe-4028-a3aa-5bf9b5634a23 req-b8da5425-b5b2-4f4e-96a2-f885538e1c8c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0502312 Dec 08 11:35:57.499903 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1f2538d5-1cfe-4028-a3aa-5bf9b5634a23 req-0321b102-dae9-4e52-bc25-2e6f98f26266 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424750 Dec 08 11:35:57.848077 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4f8fe52-4754-4bf6-a538-7f5f10549d64 req-007f741b-b047-412a-af88-50565ef17797 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:57.850339 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4f8fe52-4754-4bf6-a538-7f5f10549d64 req-007f741b-b047-412a-af88-50565ef17797 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0675211 Dec 08 11:35:57.928834 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4f8fe52-4754-4bf6-a538-7f5f10549d64 req-c424e3ac-b523-43a5-8835-baadbd2e262d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0727262 Dec 08 11:35:57.937044 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d757dbb7-09db-4808-a762-5ba6872beef3 req-672bbddd-938e-40bc-a212-dfe292a99954 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:57.938487 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d757dbb7-09db-4808-a762-5ba6872beef3 req-672bbddd-938e-40bc-a212-dfe292a99954 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0813487 Dec 08 11:35:57.985993 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d757dbb7-09db-4808-a762-5ba6872beef3 req-ef3571dc-307e-4b29-96fe-654d2a594bdb tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407250 Dec 08 11:35:58.166075 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:35:58.202984 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d261c53e-9c7f-4fe7-9e2d-f26131f1c19f req-76a3d1ab-a5ca-4b64-bc27-4b1750debc43 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:58.204513 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d261c53e-9c7f-4fe7-9e2d-f26131f1c19f req-76a3d1ab-a5ca-4b64-bc27-4b1750debc43 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0507367 Dec 08 11:35:58.254812 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d261c53e-9c7f-4fe7-9e2d-f26131f1c19f req-ed60d18f-6845-4bb2-8117-a4ec88b78ced tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442972 Dec 08 11:35:58.624712 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e6f874-3e26-4eed-a5e3-c7b15f4335c8 req-d757f4cb-419a-4587-8465-8cb468aba87a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:58.626367 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-77e6f874-3e26-4eed-a5e3-c7b15f4335c8 req-d757f4cb-419a-4587-8465-8cb468aba87a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0477183 Dec 08 11:35:58.677677 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-77e6f874-3e26-4eed-a5e3-c7b15f4335c8 req-8e41a4ac-b943-4768-811d-8618ac97d072 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433214 Dec 08 11:35:59.059037 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-666a86a1-2224-4fc5-901f-5a3f7836346f req-481d4a1b-973e-4d73-95dc-b99fe2674683 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:59.060720 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-666a86a1-2224-4fc5-901f-5a3f7836346f req-481d4a1b-973e-4d73-95dc-b99fe2674683 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0581827 Dec 08 11:35:59.135850 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd99b9e-b9b0-4f33-a905-cb38c1a54de1 req-44bac5b6-381a-469b-94bc-068339c7ff27 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:59.137333 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4bd99b9e-b9b0-4f33-a905-cb38c1a54de1 req-44bac5b6-381a-469b-94bc-068339c7ff27 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0755169 Dec 08 11:35:59.141628 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-666a86a1-2224-4fc5-901f-5a3f7836346f req-17147396-6fc8-47d5-b02b-4faa2b290a78 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0701418 Dec 08 11:35:59.184768 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4bd99b9e-b9b0-4f33-a905-cb38c1a54de1 req-e6bfed0e-afe3-40a0-8cf7-0d6e09f34476 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408249 Dec 08 11:35:59.370315 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fff13d37-015b-4f76-ace4-451d38c776a2 req-e2af24b2-aa3e-4c1f-bff8-5c35f4a1743c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:59.371772 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fff13d37-015b-4f76-ace4-451d38c776a2 req-e2af24b2-aa3e-4c1f-bff8-5c35f4a1743c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0494428 Dec 08 11:35:59.416437 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fff13d37-015b-4f76-ace4-451d38c776a2 req-d745187c-0fcb-4e4e-b9c1-4ff43a7a641b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382385 Dec 08 11:35:59.796013 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fc51f50-dcfe-4f17-ba8b-12bf4aa05831 req-ca37e5a8-260a-4618-a8bc-587a6230f432 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:35:59.797936 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6fc51f50-dcfe-4f17-ba8b-12bf4aa05831 req-ca37e5a8-260a-4618-a8bc-587a6230f432 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0569630 Dec 08 11:35:59.845232 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6fc51f50-dcfe-4f17-ba8b-12bf4aa05831 req-8b9b3ed0-70d8-4b1c-8aef-6c58aac3ad78 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412190 Dec 08 11:36:00.266492 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfea236f-ee47-4d9a-87f9-d612a39154ec req-e4a70286-d90c-4fef-896f-05edbabdf877 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:00.268243 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cfea236f-ee47-4d9a-87f9-d612a39154ec req-e4a70286-d90c-4fef-896f-05edbabdf877 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0492826 Dec 08 11:36:00.345260 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ae7ad91-396d-41b3-9487-a7521e04625a req-70153acd-3b61-46cd-a964-1718622fab01 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:00.347189 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3ae7ad91-396d-41b3-9487-a7521e04625a req-70153acd-3b61-46cd-a964-1718622fab01 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0780623 Dec 08 11:36:00.350925 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cfea236f-ee47-4d9a-87f9-d612a39154ec req-f32e05e5-4811-43e5-8b9d-07cedfc77192 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0740006 Dec 08 11:36:00.398376 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3ae7ad91-396d-41b3-9487-a7521e04625a req-2855eaa8-4b1d-4626-877d-7af0f758bcaf tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414302 Dec 08 11:36:00.529106 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebcfe455-2fad-495c-bed4-c1a0e8852b47 req-433c943a-1d8c-47f2-81b1-20c4a0d80b77 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:00.530733 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ebcfe455-2fad-495c-bed4-c1a0e8852b47 req-433c943a-1d8c-47f2-81b1-20c4a0d80b77 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0497363 Dec 08 11:36:00.589180 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ebcfe455-2fad-495c-bed4-c1a0e8852b47 req-2fca4fc9-355d-4b45-90a4-8dcb44126289 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518923 Dec 08 11:36:00.960538 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebccdf62-b13f-4524-b94c-ba76e709897f req-c77f7932-0742-41a3-889d-d0776273e35b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:00.962278 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ebccdf62-b13f-4524-b94c-ba76e709897f req-c77f7932-0742-41a3-889d-d0776273e35b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0520904 Dec 08 11:36:01.014739 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ebccdf62-b13f-4524-b94c-ba76e709897f req-5bbb4ed1-3116-4fcb-abfa-a84e98b20393 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423791 Dec 08 11:36:01.477791 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a2ec873-6d3d-41db-9303-99d648c42127 req-c26e8b6c-5da9-434c-ad18-1dfabb941cdb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:01.479471 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1a2ec873-6d3d-41db-9303-99d648c42127 req-c26e8b6c-5da9-434c-ad18-1dfabb941cdb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0546749 Dec 08 11:36:01.787756 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc3e9557-6707-4c86-9929-3b6a21b63b08 req-24ed4e7c-22d3-480e-9c0b-823dad3748aa tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:01.789084 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fc3e9557-6707-4c86-9929-3b6a21b63b08 req-24ed4e7c-22d3-480e-9c0b-823dad3748aa tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.3087366 Dec 08 11:36:01.796505 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1a2ec873-6d3d-41db-9303-99d648c42127 req-f6f97020-6446-4340-b6e1-d67a954e5f34 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3049238 Dec 08 11:36:01.839948 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fc3e9557-6707-4c86-9929-3b6a21b63b08 req-5761b397-bed8-4d1c-af2d-60db85ae83bb tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424955 Dec 08 11:36:01.896003 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:36:01.900663 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6fc0299-93c4-4fc1-86b6-8c2a15e6bc1d req-de8c94a7-58ef-4fb0-9704-9aa4b22cf7f7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:01.902226 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d6fc0299-93c4-4fc1-86b6-8c2a15e6bc1d req-de8c94a7-58ef-4fb0-9704-9aa4b22cf7f7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0485888 Dec 08 11:36:01.952074 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d6fc0299-93c4-4fc1-86b6-8c2a15e6bc1d req-477fdab7-9922-4cd3-b793-7bbca9620c00 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440097 Dec 08 11:36:02.139345 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c887852-40ae-495c-8f01-b44fb1e77aba req-a3628771-8347-4918-bfa6-971f226d87f6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:02.140809 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7c887852-40ae-495c-8f01-b44fb1e77aba req-a3628771-8347-4918-bfa6-971f226d87f6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0559866 Dec 08 11:36:02.191412 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7c887852-40ae-495c-8f01-b44fb1e77aba req-c25661c4-10e4-415d-9da7-4e75e1a9a1c7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436606 Dec 08 11:36:02.922377 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a620cf4c-6f89-4d35-9676-d59cb8e2601e req-d17bc712-d6e2-4088-8e41-164e9d70fc0b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:02.924520 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a620cf4c-6f89-4d35-9676-d59cb8e2601e req-d17bc712-d6e2-4088-8e41-164e9d70fc0b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0557239 Dec 08 11:36:02.984295 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbb9f283-235b-4fba-914a-202d5b68929c req-b5f9abb0-c450-4d11-a1fd-0cbd6c8f4ec0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:02.985792 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fbb9f283-235b-4fba-914a-202d5b68929c req-b5f9abb0-c450-4d11-a1fd-0cbd6c8f4ec0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0796475 Dec 08 11:36:03.017888 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a620cf4c-6f89-4d35-9676-d59cb8e2601e req-bb7453de-5e46-486a-b7ae-b4f573a20e12 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0753510 Dec 08 11:36:03.049494 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fbb9f283-235b-4fba-914a-202d5b68929c req-0151b5ce-9a9c-4131-855d-9da236b8b98d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0558681 Dec 08 11:36:03.146845 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86189ad5-1d54-4055-a367-2f569b3e60ef req-d841cb5c-8367-4a2c-bcaf-c04fccdc524b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:03.148259 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-86189ad5-1d54-4055-a367-2f569b3e60ef req-d841cb5c-8367-4a2c-bcaf-c04fccdc524b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0620043 Dec 08 11:36:03.195714 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-86189ad5-1d54-4055-a367-2f569b3e60ef req-720b7c7a-0e74-4192-a737-45fc6c662ec7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413487 Dec 08 11:36:03.304546 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4ec5a7a-9e3b-4d12-9c18-1d39e3a27fb6 req-221a607f-2191-44bf-8bfd-e85007467cab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:03.306015 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a4ec5a7a-9e3b-4d12-9c18-1d39e3a27fb6 req-221a607f-2191-44bf-8bfd-e85007467cab tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0484259 Dec 08 11:36:03.359079 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a4ec5a7a-9e3b-4d12-9c18-1d39e3a27fb6 req-e62f79ed-58e8-4dde-b430-a8ab80cc965a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465918 Dec 08 11:36:04.176313 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35a399ee-3cfd-4599-aebe-f9573d49d387 req-359353c9-9146-42f4-a788-3379d77c0d4b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:04.177902 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-35a399ee-3cfd-4599-aebe-f9573d49d387 req-359353c9-9146-42f4-a788-3379d77c0d4b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0860066 Dec 08 11:36:04.197763 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38717e30-9a68-40ba-9b3a-fed361b04a65 req-90e95638-32a3-416e-a102-a6cab5f1117d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:04.199202 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-38717e30-9a68-40ba-9b3a-fed361b04a65 req-90e95638-32a3-416e-a102-a6cab5f1117d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0782485 Dec 08 11:36:04.264375 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-35a399ee-3cfd-4599-aebe-f9573d49d387 req-5a7ab72e-fdf6-4f18-ab54-60f8e9cf98da tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0798273 Dec 08 11:36:04.269324 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-38717e30-9a68-40ba-9b3a-fed361b04a65 req-c59dbe9c-591f-41db-be90-aa65b7c859d3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625288 Dec 08 11:36:04.369760 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56885561-e1b8-445d-8a05-d2e47b9ea0f9 req-307f2e89-c6e9-4707-8971-db0748646523 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:04.371223 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-56885561-e1b8-445d-8a05-d2e47b9ea0f9 req-307f2e89-c6e9-4707-8971-db0748646523 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0484867 Dec 08 11:36:04.420995 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-56885561-e1b8-445d-8a05-d2e47b9ea0f9 req-ebaa97d9-1ac4-4c45-a7c9-2278ff8d45d4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438704 Dec 08 11:36:04.484229 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a88824c-fdcc-4b7c-bcc5-461cb98ea4a3 req-9cc1576e-ecaf-4135-ad61-fab8baa91b91 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:04.485737 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1a88824c-fdcc-4b7c-bcc5-461cb98ea4a3 req-9cc1576e-ecaf-4135-ad61-fab8baa91b91 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0555785 Dec 08 11:36:04.531618 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1a88824c-fdcc-4b7c-bcc5-461cb98ea4a3 req-441a08d4-35c8-40bc-960c-b87af328e95f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399053 Dec 08 11:36:05.414525 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6160065e-f72b-4e57-a5af-9e8c3d0f98d9 req-fcc03622-85b0-44f1-8b8a-a34850a7e3c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:05.415900 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6160065e-f72b-4e57-a5af-9e8c3d0f98d9 req-fcc03622-85b0-44f1-8b8a-a34850a7e3c6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0749714 Dec 08 11:36:05.424327 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46d08822-caf4-4c10-8e96-e02f2503fdde req-077f944f-bf59-43c8-b49e-68ecbfa7eae5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:05.425703 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-46d08822-caf4-4c10-8e96-e02f2503fdde req-077f944f-bf59-43c8-b49e-68ecbfa7eae5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0759628 Dec 08 11:36:05.497846 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6160065e-f72b-4e57-a5af-9e8c3d0f98d9 req-965e7117-3360-4a20-abca-2e937d31f25a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712018 Dec 08 11:36:05.501287 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-46d08822-caf4-4c10-8e96-e02f2503fdde req-0e2c1e19-3254-4c5d-b59d-357dc4be4334 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0691986 Dec 08 11:36:05.603443 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab897cd9-9667-43a0-8524-0a52a9f6e318 req-13b9311b-84e6-4aa6-a17d-549ea790c3d3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:05.604936 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ab897cd9-9667-43a0-8524-0a52a9f6e318 req-13b9311b-84e6-4aa6-a17d-549ea790c3d3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0531607 Dec 08 11:36:05.683458 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84bc7a29-f92f-44c6-9d8b-4941c2bd8e18 req-a78301cb-ff3f-45bf-9bc0-e5bc9035c779 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:05.684872 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-84bc7a29-f92f-44c6-9d8b-4941c2bd8e18 req-a78301cb-ff3f-45bf-9bc0-e5bc9035c779 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0759802 Dec 08 11:36:05.690134 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ab897cd9-9667-43a0-8524-0a52a9f6e318 req-4c9cb6cb-bdb4-4f21-a7f0-98f37ba14a61 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723417 Dec 08 11:36:05.745365 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-84bc7a29-f92f-44c6-9d8b-4941c2bd8e18 req-0e805c84-3d9e-4ff4-a805-dbafe1b6bb8d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506871 Dec 08 11:36:06.620024 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8987ec94-9229-4b75-897e-44719dccfb8d req-76878ac2-b5a6-4951-b1d9-7d64799d45e1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:06.621513 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8987ec94-9229-4b75-897e-44719dccfb8d req-76878ac2-b5a6-4951-b1d9-7d64799d45e1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0539885 Dec 08 11:36:06.700626 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8987ec94-9229-4b75-897e-44719dccfb8d req-8b0ef821-cac3-4712-9fbb-40cc4dde5aaf tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727286 Dec 08 11:36:06.713088 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e06d607-5e1d-4b4e-8ae7-30bda07487d3 req-4c657dd9-3e0f-41e5-a9ea-ce64df16058f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:06.714576 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0e06d607-5e1d-4b4e-8ae7-30bda07487d3 req-4c657dd9-3e0f-41e5-a9ea-ce64df16058f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.1215315 Dec 08 11:36:06.776109 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0e06d607-5e1d-4b4e-8ae7-30bda07487d3 req-7dde2eec-04cd-4bec-b65d-f27ba69aea21 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0529664 Dec 08 11:36:06.816919 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36404350-b322-459c-aa5b-75a02b1a9285 req-638f3bba-f332-400b-a5cf-42f5d52b3047 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:06.818454 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-36404350-b322-459c-aa5b-75a02b1a9285 req-638f3bba-f332-400b-a5cf-42f5d52b3047 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0608225 Dec 08 11:36:06.894397 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-36404350-b322-459c-aa5b-75a02b1a9285 req-9d314e37-e88b-4d37-9f43-1ca5e407049b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700245 Dec 08 11:36:06.905918 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebb3a834-189a-4846-80e2-31e333e705ba req-2169ffaa-4b3d-45a7-9e61-257b111470f5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:06.907379 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ebb3a834-189a-4846-80e2-31e333e705ba req-2169ffaa-4b3d-45a7-9e61-257b111470f5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0695887 Dec 08 11:36:06.954346 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ebb3a834-189a-4846-80e2-31e333e705ba req-9135f420-ad65-4344-812d-ff4147c8f8da tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412247 Dec 08 11:36:07.904949 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d1af8db-f035-44a8-aaa0-c7143f25266f req-7acdcf67-06c2-4520-8f21-b6acea59e0e6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:07.906913 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3d1af8db-f035-44a8-aaa0-c7143f25266f req-7acdcf67-06c2-4520-8f21-b6acea59e0e6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.1405375 Dec 08 11:36:07.923968 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d6bd89d-7ded-48a0-a622-38863293e2de req-d3f424a7-2175-4514-be73-b3f4c9031b94 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:07.925528 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1d6bd89d-7ded-48a0-a622-38863293e2de req-d3f424a7-2175-4514-be73-b3f4c9031b94 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0758622 Dec 08 11:36:07.995691 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3d1af8db-f035-44a8-aaa0-c7143f25266f req-6c4901b0-ff0e-4433-aea1-f6eecdb14aef tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0812571 Dec 08 11:36:08.003282 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1d6bd89d-7ded-48a0-a622-38863293e2de req-695baa24-cd64-4ddd-a799-57d0c8dec0a3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0713847 Dec 08 11:36:08.099163 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-263a027a-73e3-423a-9d3b-80353c40b726 req-babf67dd-cd1e-4c37-9e85-7f7b2711495a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:08.100705 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-263a027a-73e3-423a-9d3b-80353c40b726 req-babf67dd-cd1e-4c37-9e85-7f7b2711495a tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0515199 Dec 08 11:36:08.178956 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-263a027a-73e3-423a-9d3b-80353c40b726 req-f0d529de-752e-4960-bc01-b10facb0c8b0 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721982 Dec 08 11:36:08.191794 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a29b0aff-d3d2-41ef-9d72-3d5b5cfdace3 req-d86f4c48-37ff-4023-b4b3-566b241642b0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:08.193270 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a29b0aff-d3d2-41ef-9d72-3d5b5cfdace3 req-d86f4c48-37ff-4023-b4b3-566b241642b0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0734799 Dec 08 11:36:08.241964 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a29b0aff-d3d2-41ef-9d72-3d5b5cfdace3 req-8c88772d-4d48-495e-affa-3f55e136475a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422230 Dec 08 11:36:09.145931 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb6db671-a865-4084-a3ef-4ea35c87ffd1 req-92136122-86e7-4430-96f6-d2f61e67ff93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:09.146667 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cb6db671-a865-4084-a3ef-4ea35c87ffd1 req-92136122-86e7-4430-96f6-d2f61e67ff93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0720129 Dec 08 11:36:09.155092 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bcf7694-bd47-480a-87e9-80ec97c867b5 req-e66ceaf0-f848-4c95-ac39-c1b573a78e4d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:09.156680 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1bcf7694-bd47-480a-87e9-80ec97c867b5 req-e66ceaf0-f848-4c95-ac39-c1b573a78e4d tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0930090 Dec 08 11:36:09.230999 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cb6db671-a865-4084-a3ef-4ea35c87ffd1 req-ed924d2a-98a8-4083-be87-b4fb67afb827 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0730717 Dec 08 11:36:09.266214 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1bcf7694-bd47-480a-87e9-80ec97c867b5 req-7b1ccae6-9886-4819-82b9-1e062b71dec4 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1013272 Dec 08 11:36:09.384652 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-183588d1-6d78-4966-bddc-13a0927c1031 req-5b6247e2-84ed-42f0-92d8-431cd7335d9f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:09.386147 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-183588d1-6d78-4966-bddc-13a0927c1031 req-5b6247e2-84ed-42f0-92d8-431cd7335d9f tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0764630 Dec 08 11:36:09.398869 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42f7b5af-4207-42e3-a4f6-a525175a88cc req-4642ae26-a8fd-41c2-94e5-9a2b46083aea tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:09.400318 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-42f7b5af-4207-42e3-a4f6-a525175a88cc req-4642ae26-a8fd-41c2-94e5-9a2b46083aea tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0641568 Dec 08 11:36:09.478627 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-183588d1-6d78-4966-bddc-13a0927c1031 req-6f422681-87f0-4cb2-9d3f-3a80ae0f4fd5 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773337 Dec 08 11:36:09.485637 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-42f7b5af-4207-42e3-a4f6-a525175a88cc req-091e61f1-65ca-4a79-bd6c-da792882bb0e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783386 Dec 08 11:36:10.379174 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c03c24a-09c0-4dc8-abd5-3efb50c0ea64 req-93d72331-2c43-4a33-a450-7be2d08f295a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:10.380631 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9c03c24a-09c0-4dc8-abd5-3efb50c0ea64 req-93d72331-2c43-4a33-a450-7be2d08f295a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0740702 Dec 08 11:36:10.417762 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c984969a-b7f0-4d7e-a5f1-cbefbe5a686c req-1f9cdbf8-e859-46a6-b800-7ab5682d3920 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:10.419239 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c984969a-b7f0-4d7e-a5f1-cbefbe5a686c req-1f9cdbf8-e859-46a6-b800-7ab5682d3920 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0753236 Dec 08 11:36:10.457431 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9c03c24a-09c0-4dc8-abd5-3efb50c0ea64 req-54cc6605-76dc-4a51-83a7-fb52e3aa13a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0701365 Dec 08 11:36:10.484215 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c984969a-b7f0-4d7e-a5f1-cbefbe5a686c req-0dcd4b60-b236-4e91-ad9c-81378fbaf2c1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545008 Dec 08 11:36:10.632577 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7967208f-95c1-47a1-a78d-ac9d218cfa51 req-9f693c9e-7bd2-4154-8760-3338cb13af4d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:10.634019 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7967208f-95c1-47a1-a78d-ac9d218cfa51 req-9f693c9e-7bd2-4154-8760-3338cb13af4d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0813639 Dec 08 11:36:10.642402 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4977cfca-2ad3-42d0-966d-ed817dafe6f8 req-57e900db-1729-4f11-97ab-cc4b155012ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:10.643762 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4977cfca-2ad3-42d0-966d-ed817dafe6f8 req-57e900db-1729-4f11-97ab-cc4b155012ec tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0820544 Dec 08 11:36:10.713935 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7967208f-95c1-47a1-a78d-ac9d218cfa51 req-00fd04d4-f724-4cc7-a782-e7f24bda2cef tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0692234 Dec 08 11:36:10.718262 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4977cfca-2ad3-42d0-966d-ed817dafe6f8 req-ff954dae-9590-4398-b91e-519356eb4ee9 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0679543 Dec 08 11:36:11.612469 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5864ca2a-1001-4eae-a151-c86df27e6224 req-c812511e-387f-4b6b-977b-dfc7dae252b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:11.613962 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5864ca2a-1001-4eae-a151-c86df27e6224 req-c812511e-387f-4b6b-977b-dfc7dae252b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0797453 Dec 08 11:36:11.625506 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86037eb5-dc81-45d7-b45b-d4fc30111fb8 req-c3da6c5a-38e5-4106-9ede-51cd25229688 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:11.627578 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-86037eb5-dc81-45d7-b45b-d4fc30111fb8 req-c3da6c5a-38e5-4106-9ede-51cd25229688 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0678842 Dec 08 11:36:11.695017 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5864ca2a-1001-4eae-a151-c86df27e6224 req-312194db-809d-4206-8447-6d952c19d1ae tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0664272 Dec 08 11:36:11.709057 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-86037eb5-dc81-45d7-b45b-d4fc30111fb8 req-ecd46e48-a214-4059-9c42-6dab16256340 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0745668 Dec 08 11:36:11.853846 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af00c312-a46f-4da0-aeff-817d5498627a req-1b89beeb-466e-416c-b34e-291877573e7b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:11.855326 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-af00c312-a46f-4da0-aeff-817d5498627a req-1b89beeb-466e-416c-b34e-291877573e7b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0763123 Dec 08 11:36:11.866680 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6943333d-2204-4d38-a348-ddd3e4198e3e req-b4dce8a1-d05a-44b6-8db9-3b984ec5b3b7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:11.868038 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6943333d-2204-4d38-a348-ddd3e4198e3e req-b4dce8a1-d05a-44b6-8db9-3b984ec5b3b7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0642600 Dec 08 11:36:11.945638 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6943333d-2204-4d38-a348-ddd3e4198e3e req-2b97b4ea-c0ee-430c-a527-e11336f2c70c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710905 Dec 08 11:36:11.948822 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-af00c312-a46f-4da0-aeff-817d5498627a req-1ce9d446-7127-4578-94f4-9a79625a9695 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0799265 Dec 08 11:36:12.840770 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aefa010f-91a8-432a-973f-4896de939391 req-6e77c4f7-4ab6-4c9d-906b-2b1b3184c05a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:12.842262 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-aefa010f-91a8-432a-973f-4896de939391 req-6e77c4f7-4ab6-4c9d-906b-2b1b3184c05a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0759175 Dec 08 11:36:12.850850 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491bc22d-bc69-4c90-94d7-e45d2e9e41a5 req-44c512c2-652d-4841-befe-19a53e0c798a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:12.853017 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-491bc22d-bc69-4c90-94d7-e45d2e9e41a5 req-44c512c2-652d-4841-befe-19a53e0c798a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0760982 Dec 08 11:36:12.927142 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-aefa010f-91a8-432a-973f-4896de939391 req-e6b50a91-3530-4f68-ae66-cdd85291c5ff tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0731409 Dec 08 11:36:12.931339 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-491bc22d-bc69-4c90-94d7-e45d2e9e41a5 req-198a191a-e562-4196-ad17-003226161ebd tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0714757 Dec 08 11:36:13.085889 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23db0dde-c62d-416c-ae00-a91b3848cc68 req-f735638b-14da-4540-835b-727b379b0cf7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:13.087378 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-23db0dde-c62d-416c-ae00-a91b3848cc68 req-f735638b-14da-4540-835b-727b379b0cf7 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0766225 Dec 08 11:36:13.100376 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae070f6b-ff98-40ca-9eb1-93051cc22c2f req-302e044b-3996-43a9-89a1-5053aa9c37bc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:13.102032 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ae070f6b-ff98-40ca-9eb1-93051cc22c2f req-302e044b-3996-43a9-89a1-5053aa9c37bc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0802193 Dec 08 11:36:13.172012 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-23db0dde-c62d-416c-ae00-a91b3848cc68 req-8b13d20c-0ef0-4621-b819-416fefce6d1c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688887 Dec 08 11:36:13.176313 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ae070f6b-ff98-40ca-9eb1-93051cc22c2f req-22571964-77a5-4309-902c-14295ba8b6dc tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0675230 Dec 08 11:36:14.077211 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e182d38-9bf8-4401-887b-08db3948e029 req-4ce9eb19-50a4-4ff8-a7ee-24584dfcc2c9 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:14.078699 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9e182d38-9bf8-4401-887b-08db3948e029 req-4ce9eb19-50a4-4ff8-a7ee-24584dfcc2c9 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0812819 Dec 08 11:36:14.086830 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-391cbdfd-76b6-45f1-a5ad-0b9d6e86fac8 req-e137faf3-d849-48e5-bc54-4f633ccaa65b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:14.088257 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-391cbdfd-76b6-45f1-a5ad-0b9d6e86fac8 req-e137faf3-d849-48e5-bc54-4f633ccaa65b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0896006 Dec 08 11:36:14.160626 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9e182d38-9bf8-4401-887b-08db3948e029 req-416ff850-d668-42e7-8150-b5b072cb2c5f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713935 Dec 08 11:36:14.163930 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-391cbdfd-76b6-45f1-a5ad-0b9d6e86fac8 req-7ad3097c-2f8e-4536-861e-1847847e6c27 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0690057 Dec 08 11:36:14.317411 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1234965b-0c51-42d6-bd60-75e02c5d84af req-938efdd9-fe2b-4c7b-ae1c-6306e9551be3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:14.318882 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1234965b-0c51-42d6-bd60-75e02c5d84af req-938efdd9-fe2b-4c7b-ae1c-6306e9551be3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0799630 Dec 08 11:36:14.326826 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebfd4b8a-4210-45a5-a1fc-a9df448fe354 req-8ae0eb4e-b9bd-4684-9dd5-213224756076 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:14.328167 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ebfd4b8a-4210-45a5-a1fc-a9df448fe354 req-8ae0eb4e-b9bd-4684-9dd5-213224756076 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0787003 Dec 08 11:36:14.399631 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1234965b-0c51-42d6-bd60-75e02c5d84af req-dcdde490-9f13-4eb8-9203-4c66f4817530 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705061 Dec 08 11:36:14.404324 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ebfd4b8a-4210-45a5-a1fc-a9df448fe354 req-8a7760c0-ca1a-44c5-ac11-9d9f8aad49d0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0691912 Dec 08 11:36:15.307546 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4d62b8e-dce0-4129-adb2-4547294ff7bc req-c2d82471-8925-455a-b242-be3e3a6ec4ee tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:15.308985 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f4d62b8e-dce0-4129-adb2-4547294ff7bc req-c2d82471-8925-455a-b242-be3e3a6ec4ee tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0783310 Dec 08 11:36:15.320522 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d60fe623-274d-4c60-9fd6-7effbbf4823c req-440a9ea6-9832-453d-b68d-6e23ed19218f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:15.321988 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d60fe623-274d-4c60-9fd6-7effbbf4823c req-440a9ea6-9832-453d-b68d-6e23ed19218f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0814650 Dec 08 11:36:15.386618 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f4d62b8e-dce0-4129-adb2-4547294ff7bc req-817f5975-5bb4-4bbb-b41c-3f44d051c7b4 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0635920 Dec 08 11:36:15.402164 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d60fe623-274d-4c60-9fd6-7effbbf4823c req-03e638f4-7bf9-4c73-9f0a-4ff76ea06c99 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0737829 Dec 08 11:36:15.558630 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18ebe35b-5061-4506-b57f-e703ae197379 req-ee4382f8-a0df-4d52-aaf8-86a116fafba7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:15.560180 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-18ebe35b-5061-4506-b57f-e703ae197379 req-ee4382f8-a0df-4d52-aaf8-86a116fafba7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0801966 Dec 08 11:36:15.573952 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f56a6623-2262-4d64-bba7-4e5f842de9f3 req-b1704ab2-52c2-4751-9f67-2eeaae39e8e8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:15.575452 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f56a6623-2262-4d64-bba7-4e5f842de9f3 req-b1704ab2-52c2-4751-9f67-2eeaae39e8e8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0849516 Dec 08 11:36:15.652766 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f56a6623-2262-4d64-bba7-4e5f842de9f3 req-a179a9b9-c29e-498b-8f85-cdaed4b8f562 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705247 Dec 08 11:36:15.655785 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-18ebe35b-5061-4506-b57f-e703ae197379 req-39522b01-dd3f-4de6-8b5f-0de5ce107f10 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0794213 Dec 08 11:36:16.527114 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-405f24d5-d50a-438f-aef4-e41e1d050a5e req-b55e7bcc-a29c-4020-a8b2-efbc83b922dc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:16.528578 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-405f24d5-d50a-438f-aef4-e41e1d050a5e req-b55e7bcc-a29c-4020-a8b2-efbc83b922dc tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0756543 Dec 08 11:36:16.539568 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0456fbf-8257-4680-a9d7-d895674e170f req-c116fa62-30c5-4705-94cc-98622f2f99c6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:16.540920 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f0456fbf-8257-4680-a9d7-d895674e170f req-c116fa62-30c5-4705-94cc-98622f2f99c6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0636840 Dec 08 11:36:16.615959 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-405f24d5-d50a-438f-aef4-e41e1d050a5e req-ba5ae958-e928-462f-91af-5d7613c74c3f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740738 Dec 08 11:36:16.622837 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f0456fbf-8257-4680-a9d7-d895674e170f req-af466ecb-d007-4fc8-b14c-fa112d9a7e2c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0754967 Dec 08 11:36:16.801078 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c55e0940-0b15-4f58-a95d-fe83e12bdb61 req-9a4cfa59-76c4-4ee1-ab89-d1dacf81c023 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:16.802584 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c55e0940-0b15-4f58-a95d-fe83e12bdb61 req-9a4cfa59-76c4-4ee1-ab89-d1dacf81c023 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0796297 Dec 08 11:36:16.815268 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a853553-233e-4ff5-a0a7-358436ccd34d req-1e0409cf-54f5-43e7-bf1b-fc6144d06b02 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:16.816750 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5a853553-233e-4ff5-a0a7-358436ccd34d req-1e0409cf-54f5-43e7-bf1b-fc6144d06b02 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0850046 Dec 08 11:36:16.888221 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c55e0940-0b15-4f58-a95d-fe83e12bdb61 req-1578460f-69e2-407d-a716-cd5c866f8744 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704477 Dec 08 11:36:16.891383 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5a853553-233e-4ff5-a0a7-358436ccd34d req-33ca2275-cb62-472a-85e1-0a74f8d1fcdc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0678227 Dec 08 11:36:17.578036 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:17.759062 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ebf502b-fedb-4e49-acac-74ca386a53fe req-7eff37cb-b8be-48c6-937b-59edbd48798b tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:17.760508 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3ebf502b-fedb-4e49-acac-74ca386a53fe req-7eff37cb-b8be-48c6-937b-59edbd48798b tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0773895 Dec 08 11:36:17.773132 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75fe0e4e-d34f-4a59-99b0-1bc4ba7eb580 req-a86bb1f5-20b3-46e6-ab15-c5b0aea335dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:17.774515 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-75fe0e4e-d34f-4a59-99b0-1bc4ba7eb580 req-a86bb1f5-20b3-46e6-ab15-c5b0aea335dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0791230 Dec 08 11:36:17.841372 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3ebf502b-fedb-4e49-acac-74ca386a53fe req-bcd4e5ca-f86b-4a88-b51a-3234ccd3c23e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658190 Dec 08 11:36:17.848136 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-75fe0e4e-d34f-4a59-99b0-1bc4ba7eb580 req-20f25991-3c1c-4c7d-8459-5974ed44fbfe tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0663571 Dec 08 11:36:18.035979 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-947b7eb7-a2a5-4e30-8a8e-a0f8bfedcaab req-d129b553-d92b-4c29-b346-4c8ea8fd7a7a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:18.037451 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-947b7eb7-a2a5-4e30-8a8e-a0f8bfedcaab req-d129b553-d92b-4c29-b346-4c8ea8fd7a7a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0781200 Dec 08 11:36:18.045341 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be591780-daf3-40fc-b65b-d89cec2a1ee2 req-a1dc858f-57a4-4ae8-ba1a-a8c628f933ad tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:18.046708 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-be591780-daf3-40fc-b65b-d89cec2a1ee2 req-a1dc858f-57a4-4ae8-ba1a-a8c628f933ad tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0893185 Dec 08 11:36:18.115895 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-947b7eb7-a2a5-4e30-8a8e-a0f8bfedcaab req-5642ddd1-8b51-482f-a589-2be6cd334c14 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0681601 Dec 08 11:36:18.120109 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-be591780-daf3-40fc-b65b-d89cec2a1ee2 req-fa997d71-293a-43b2-9470-2e477e363b7b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0668983 Dec 08 11:36:18.984714 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db238b8c-f186-4863-8ce2-d4d6cf8ee7e5 req-fb82dca8-3ec6-4074-9804-be9c6f52174a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:18.986170 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-db238b8c-f186-4863-8ce2-d4d6cf8ee7e5 req-fb82dca8-3ec6-4074-9804-be9c6f52174a tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0791440 Dec 08 11:36:18.997953 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0138d5a9-4ecb-4fc8-8b79-33c0a4d825a4 req-84c3d85e-783c-49fe-989f-2b046a30163b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:18.999295 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0138d5a9-4ecb-4fc8-8b79-33c0a4d825a4 req-84c3d85e-783c-49fe-989f-2b046a30163b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0798120 Dec 08 11:36:19.069881 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-db238b8c-f186-4863-8ce2-d4d6cf8ee7e5 req-fda7d3e4-eb93-4dd3-bd3d-9564d1f51ce6 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694616 Dec 08 11:36:19.072998 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0138d5a9-4ecb-4fc8-8b79-33c0a4d825a4 req-86e06543-53df-4964-8261-bbd339c88852 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0670190 Dec 08 11:36:19.255489 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a888269a-3e99-42fe-b8cf-e0211c72afbd req-8c81d889-4277-4ccb-83f3-ebd96f81ac58 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:19.256956 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a888269a-3e99-42fe-b8cf-e0211c72afbd req-8c81d889-4277-4ccb-83f3-ebd96f81ac58 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0746722 Dec 08 11:36:19.264011 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b1cf960-6654-47f1-b24a-2db9a82fd711 req-b3670066-3517-43cf-86ad-cb5ed3b062ff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:19.265384 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3b1cf960-6654-47f1-b24a-2db9a82fd711 req-b3670066-3517-43cf-86ad-cb5ed3b062ff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0737875 Dec 08 11:36:19.338385 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a888269a-3e99-42fe-b8cf-e0211c72afbd req-dcb887d9-0ea9-4dd6-aef7-c785fdb7d445 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720661 Dec 08 11:36:19.341894 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3b1cf960-6654-47f1-b24a-2db9a82fd711 req-4cf6799c-3d8d-4157-99e2-b41788e3dfea tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690086 Dec 08 11:36:20.058949 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-207bbd4e-3e59-4903-b038-3f995a9c1f6b req-4e767f73-05ba-4fd4-92f0-b73377a24206 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0388796 Dec 08 11:36:20.128169 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207bbd4e-3e59-4903-b038-3f995a9c1f6b req-5629262b-8fdf-45d8-a6bf-b5a71aec01e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:20.129764 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-207bbd4e-3e59-4903-b038-3f995a9c1f6b req-5629262b-8fdf-45d8-a6bf-b5a71aec01e7 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=9c60094b48d34489b46e92ae73d7e33a&device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 1098 time: 0.0445242 Dec 08 11:36:20.310688 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ffb1ea6-ff8d-4168-8ecf-ffb576128cec req-5a6174a5-e795-46d8-a958-3197b3f9daa0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:20.312086 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7ffb1ea6-ff8d-4168-8ecf-ffb576128cec req-5a6174a5-e795-46d8-a958-3197b3f9daa0 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.1660171 Dec 08 11:36:20.334586 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3514ca6b-56a9-4ddd-a3e3-245e02ae4adb req-7bf50b0f-e858-4de7-b5c7-1234d2a69f54 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:20.335992 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3514ca6b-56a9-4ddd-a3e3-245e02ae4adb req-7bf50b0f-e858-4de7-b5c7-1234d2a69f54 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.1787617 Dec 08 11:36:20.346367 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-202672de-1bef-493a-93a0-3313d29666b2 req-29a3f7bd-d748-4228-9bbb-ea085dbfdc8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:20.347734 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-202672de-1bef-493a-93a0-3313d29666b2 req-29a3f7bd-d748-4228-9bbb-ea085dbfdc8b service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 1099 time: 0.1689186 Dec 08 11:36:20.397854 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207bbd4e-3e59-4903-b038-3f995a9c1f6b req-2a41ebef-b146-467a-941c-f6176f8caf0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:20.399240 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-207bbd4e-3e59-4903-b038-3f995a9c1f6b req-2a41ebef-b146-467a-941c-f6176f8caf0c service neutron] 10.222.0.61 "GET /v2.0/networks?id=185aeb08-41ef-4fae-a420-33296f710850 HTTP/1.1" status: 200 len: 911 time: 0.2193904 Dec 08 11:36:20.494111 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7ffb1ea6-ff8d-4168-8ecf-ffb576128cec req-d8f48477-4bd2-47fc-8332-c795a10b4050 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1735289 Dec 08 11:36:20.500043 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3514ca6b-56a9-4ddd-a3e3-245e02ae4adb req-72b23109-8e5a-41c1-829e-e756c7f14731 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1501954 Dec 08 11:36:20.506446 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-202672de-1bef-493a-93a0-3313d29666b2 req-8cfdc5dc-7ce6-4904-9ba6-6624d4eec107 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1424296 Dec 08 11:36:20.528122 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-207bbd4e-3e59-4903-b038-3f995a9c1f6b req-fa4176f4-88f1-4075-a508-79df60728e14 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=731fa8a4-e27d-4561-a86e-aa21c87548e7 HTTP/1.1" status: 200 len: 1001 time: 0.1176505 Dec 08 11:36:20.633782 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c931f154-6893-4528-81ed-e5d864df8154 req-f2202fec-8441-4bc8-b5e0-96ec9bd85fb8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:20.635253 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c931f154-6893-4528-81ed-e5d864df8154 req-f2202fec-8441-4bc8-b5e0-96ec9bd85fb8 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0766191 Dec 08 11:36:20.643456 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c959831-ca10-417e-ae1c-f25a6b211045 req-c97ba9ed-cae9-4838-ab61-bb4e635d331c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:20.644796 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3c959831-ca10-417e-ae1c-f25a6b211045 req-c97ba9ed-cae9-4838-ab61-bb4e635d331c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0874138 Dec 08 11:36:20.714085 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c931f154-6893-4528-81ed-e5d864df8154 req-0c77f1ac-9cfa-4c68-9699-c1e2041dcd43 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683334 Dec 08 11:36:20.718344 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3c959831-ca10-417e-ae1c-f25a6b211045 req-2d503f17-6e28-46ac-8191-1ffb72d79ef4 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671473 Dec 08 11:36:21.076637 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207bbd4e-3e59-4903-b038-3f995a9c1f6b req-0a5c5605-28bc-452a-9217-f558a0c6fde8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:21.077977 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-207bbd4e-3e59-4903-b038-3f995a9c1f6b req-0a5c5605-28bc-452a-9217-f558a0c6fde8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=40a584f7-ce77-4d89-87c2-4f3f589c6700 HTTP/1.1" status: 200 len: 849 time: 0.0472291 Dec 08 11:36:21.125412 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207bbd4e-3e59-4903-b038-3f995a9c1f6b req-54575d97-b18f-4856-9c77-42d5f1767eaa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:21.127461 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-207bbd4e-3e59-4903-b038-3f995a9c1f6b req-54575d97-b18f-4856-9c77-42d5f1767eaa service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=185aeb08-41ef-4fae-a420-33296f710850&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392501 Dec 08 11:36:21.214809 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-207bbd4e-3e59-4903-b038-3f995a9c1f6b req-6ae9faa0-78d7-490e-9296-9a0de72fb370 service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0789135 Dec 08 11:36:21.307504 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-207bbd4e-3e59-4903-b038-3f995a9c1f6b req-842694c5-5b03-4f08-bf54-9d5be6acda7a service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830116 Dec 08 11:36:21.634862 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6946e1f-68ec-4495-accc-6afb70c7e5d5 req-090ff92a-783a-4cae-9230-aeae72da8652 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:21.636316 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a6946e1f-68ec-4495-accc-6afb70c7e5d5 req-090ff92a-783a-4cae-9230-aeae72da8652 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0738931 Dec 08 11:36:21.645028 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2389bc3-e986-475d-b993-dadfe39451c5 req-88b8fbdb-b988-40d6-a038-46d15f4cad93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:21.646390 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b2389bc3-e986-475d-b993-dadfe39451c5 req-88b8fbdb-b988-40d6-a038-46d15f4cad93 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0748053 Dec 08 11:36:21.717672 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a6946e1f-68ec-4495-accc-6afb70c7e5d5 req-0637f960-b284-42de-afc0-3ca890e10411 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703619 Dec 08 11:36:21.721860 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b2389bc3-e986-475d-b993-dadfe39451c5 req-9cdb7fb8-c059-44d6-b108-bd0e5383d602 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0691750 Dec 08 11:36:21.853696 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9af7d3d2-0f93-4053-a5cb-b8cc7503f0f1 req-3dcf5354-5371-43bb-9b23-cdd7502e5fc4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:21.855142 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9af7d3d2-0f93-4053-a5cb-b8cc7503f0f1 req-3dcf5354-5371-43bb-9b23-cdd7502e5fc4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0746579 Dec 08 11:36:21.862695 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eb7520f-a9a3-470f-aea7-fe638538b801 req-ee9dbdbf-ab93-42e6-abcb-26c31493f401 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:21.864006 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0eb7520f-a9a3-470f-aea7-fe638538b801 req-ee9dbdbf-ab93-42e6-abcb-26c31493f401 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0749617 Dec 08 11:36:21.936925 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9af7d3d2-0f93-4053-a5cb-b8cc7503f0f1 req-0002a9a8-33b3-431f-b0c8-7cb73a3a08a2 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0719817 Dec 08 11:36:21.940634 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0eb7520f-a9a3-470f-aea7-fe638538b801 req-ea47d3e4-267e-4c33-aa05-1de65fb66e74 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0701370 Dec 08 11:36:22.465403 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-362b850a-2d59-4fb1-b15b-7851e43fedbb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:22.860277 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2002b95f-6d42-496d-bf91-3152ac6eb867 req-8bfb52b8-f522-4e84-bd1d-5d5ff7357217 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:22.861799 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2002b95f-6d42-496d-bf91-3152ac6eb867 req-8bfb52b8-f522-4e84-bd1d-5d5ff7357217 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0747986 Dec 08 11:36:22.873726 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-403dbd96-634b-47ad-8248-d454e05a5e65 req-84df9dd7-6c56-49b6-84ca-6d04fbc3fe1f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:22.875106 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-403dbd96-634b-47ad-8248-d454e05a5e65 req-84df9dd7-6c56-49b6-84ca-6d04fbc3fe1f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0769312 Dec 08 11:36:22.942962 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2002b95f-6d42-496d-bf91-3152ac6eb867 req-ab44361e-d99c-4c2c-b0eb-6c6f91149720 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0669057 Dec 08 11:36:22.950266 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-403dbd96-634b-47ad-8248-d454e05a5e65 req-6d1e2fd9-8563-4344-90cc-3348f1bfefc2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0679979 Dec 08 11:36:23.083435 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b9b816-1f7e-47dc-9778-a13b78b5149c req-6af7700c-6c00-4ab8-9112-2da85318debb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:23.084934 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-92b9b816-1f7e-47dc-9778-a13b78b5149c req-6af7700c-6c00-4ab8-9112-2da85318debb tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0797269 Dec 08 11:36:23.093389 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fa2485f-5881-41c1-8adf-12b460878e98 req-bd50f5eb-1a30-4c59-b30c-84f4a8109967 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:23.094790 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4fa2485f-5881-41c1-8adf-12b460878e98 req-bd50f5eb-1a30-4c59-b30c-84f4a8109967 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0797040 Dec 08 11:36:23.166139 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-92b9b816-1f7e-47dc-9778-a13b78b5149c req-f5cf3647-21ca-49dc-a346-df04518a9abf tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703886 Dec 08 11:36:23.169391 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4fa2485f-5881-41c1-8adf-12b460878e98 req-f6226865-51ae-43e0-8a89-6d58b7ac1856 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0678983 Dec 08 11:36:23.338794 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f req-e6445ad9-5476-4ab4-adc8-e0b230c920aa tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:23.340121 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f req-e6445ad9-5476-4ab4-adc8-e0b230c920aa tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 945 time: 0.0473969 Dec 08 11:36:23.704551 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f req-6db66461-2f4e-491c-a00e-76a6cc4b725b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Deleting port 222531bb-d35b-49bb-b52a-9b0f529866e2 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:36:23.704799 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f req-6db66461-2f4e-491c-a00e-76a6cc4b725b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:23.791730 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f req-6db66461-2f4e-491c-a00e-76a6cc4b725b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] For port 222531bb-d35b-49bb-b52a-9b0f529866e2, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=222531bb-d35b-49bb-b52a-9b0f529866e2,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:36:23.792088 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f req-6db66461-2f4e-491c-a00e-76a6cc4b725b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:23.803520 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f req-6db66461-2f4e-491c-a00e-76a6cc4b725b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling delete_port for 222531bb-d35b-49bb-b52a-9b0f529866e2 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:36:23.924548 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f req-6db66461-2f4e-491c-a00e-76a6cc4b725b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:23.937629 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['d9ecab87-157e-4ccb-8423-2248bb8451ea', '1d5f08a0-9b25-48d8-a2ed-88647aec1670', 'be511646-f492-43f2-af08-bc641afcd8a2', '222531bb-d35b-49bb-b52a-9b0f529866e2'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:36:23.950272 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6db66461-2f4e-491c-a00e-76a6cc4b725b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Pushing event deleted for resources: {'Port': ['ID=222531bb-d35b-49bb-b52a-9b0f529866e2,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:24.000195 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f req-6db66461-2f4e-491c-a00e-76a6cc4b725b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] No DVR routers for this DVR port 222531bb-d35b-49bb-b52a-9b0f529866e2 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:36:24.004206 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f req-6db66461-2f4e-491c-a00e-76a6cc4b725b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:24.007780 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f5e705a5-98b3-4dff-ba0d-6db44a5c5d3f req-6db66461-2f4e-491c-a00e-76a6cc4b725b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "DELETE /v2.0/ports/222531bb-d35b-49bb-b52a-9b0f529866e2 HTTP/1.1" status: 204 len: 173 time: 0.6196442 Dec 08 11:36:24.008708 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16a3dc0f-c35b-4f26-b4da-455158247814', 'name': 'network-vif-deleted', 'tag': '222531bb-d35b-49bb-b52a-9b0f529866e2'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:36:24.017740 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f7868921-c024-480d-b4f1-40d5ced948f5" -d '{"events": [{"server_uuid": "16a3dc0f-c35b-4f26-b4da-455158247814", "name": "network-vif-deleted", "tag": "222531bb-d35b-49bb-b52a-9b0f529866e2"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:36:24.078235 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85b03fd2-036d-42d8-870f-39a7790c01f0 req-1cb9db1f-659d-4df2-80a5-07407b22cb54 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:24.086322 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85b03fd2-036d-42d8-870f-39a7790c01f0 req-1cb9db1f-659d-4df2-80a5-07407b22cb54 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0645978 Dec 08 11:36:24.152588 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85b03fd2-036d-42d8-870f-39a7790c01f0 req-e40d7b71-c643-4aa6-81ef-9908e2da02f1 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653350 Dec 08 11:36:24.237782 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:36:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a32591a1-3d3c-4bb5-983a-24c3d5562669 x-openstack-request-id: req-a32591a1-3d3c-4bb5-983a-24c3d5562669 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:36:24.238072 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16a3dc0f-c35b-4f26-b4da-455158247814", "name": "network-vif-deleted", "tag": "222531bb-d35b-49bb-b52a-9b0f529866e2", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:36:24.238523 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-a32591a1-3d3c-4bb5-983a-24c3d5562669 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:36:24.238828 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16a3dc0f-c35b-4f26-b4da-455158247814', 'name': 'network-vif-deleted', 'tag': '222531bb-d35b-49bb-b52a-9b0f529866e2', 'status': 'completed', 'code': 200} Dec 08 11:36:24.265653 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d857d20b-c5c4-4946-8261-cc9e5beae874 req-827c6037-3e21-474e-acd9-fd158e7b96d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:24.267632 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d857d20b-c5c4-4946-8261-cc9e5beae874 req-827c6037-3e21-474e-acd9-fd158e7b96d7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0608635 Dec 08 11:36:24.322830 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d857d20b-c5c4-4946-8261-cc9e5beae874 req-88bf860d-33d9-4173-bbf0-29a3dead3b0e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478766 Dec 08 11:36:24.430222 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d42c62a-339b-4a8a-bee6-22aae46a6e94 req-ff3f7609-1903-4ace-826e-7332822b1775 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:24.431527 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7d42c62a-339b-4a8a-bee6-22aae46a6e94 req-ff3f7609-1903-4ace-826e-7332822b1775 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0520127 Dec 08 11:36:24.525441 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7d42c62a-339b-4a8a-bee6-22aae46a6e94 req-b4d7e969-181e-43b6-8f74-b53549dba596 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0863805 Dec 08 11:36:24.534612 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 req-99d23793-5647-4a86-b9b9-3891d4c9bfff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:24.536123 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 req-99d23793-5647-4a86-b9b9-3891d4c9bfff tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.61 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 946 time: 0.0894134 Dec 08 11:36:24.615923 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-67c51551-d449-4bb2-9e67-5fc45e14326a req-363119ca-7222-48bd-b731-c4635e915e4e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=16a3dc0f-c35b-4f26-b4da-455158247814 HTTP/1.1" status: 200 len: 210 time: 0.0400457 Dec 08 11:36:24.675855 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 req-e7356dc5-019b-4c32-a23a-d090da800445 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Deleting port ec0c1efb-b1b3-47b8-91c5-b30707a7222f {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:36:24.676266 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 req-e7356dc5-019b-4c32-a23a-d090da800445 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:24.696151 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-cf038e02-70e0-4dfb-89e8-bdf64a84c434 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:24.770867 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 req-e7356dc5-019b-4c32-a23a-d090da800445 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] For port ec0c1efb-b1b3-47b8-91c5-b30707a7222f, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=ec0c1efb-b1b3-47b8-91c5-b30707a7222f,segment=NetworkSegment(aa890c2f-8ce4-49b3-a366-4788a314e043),segment_id=aa890c2f-8ce4-49b3-a366-4788a314e043)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:36:24.771128 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 req-e7356dc5-019b-4c32-a23a-d090da800445 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:24.782991 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 req-e7356dc5-019b-4c32-a23a-d090da800445 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling delete_port for ec0c1efb-b1b3-47b8-91c5-b30707a7222f owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:36:24.912331 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 req-e7356dc5-019b-4c32-a23a-d090da800445 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:24.943778 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7356dc5-019b-4c32-a23a-d090da800445 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Pushing event deleted for resources: {'Port': ['ID=ec0c1efb-b1b3-47b8-91c5-b30707a7222f,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:24.982134 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 req-e7356dc5-019b-4c32-a23a-d090da800445 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] No DVR routers for this DVR port ec0c1efb-b1b3-47b8-91c5-b30707a7222f on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:36:24.984483 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 req-e7356dc5-019b-4c32-a23a-d090da800445 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:24.988323 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ac2554bc-07ac-4ab9-9acd-8ae4591f5354 req-e7356dc5-019b-4c32-a23a-d090da800445 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.61 "DELETE /v2.0/ports/ec0c1efb-b1b3-47b8-91c5-b30707a7222f HTTP/1.1" status: 204 len: 173 time: 0.4385910 Dec 08 11:36:25.540501 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a1cdfb9-f783-4d83-9d1d-a21d35a17788 req-edc38c81-be8f-4f9f-aa9a-3c139bc5fb02 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:25.542083 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4a1cdfb9-f783-4d83-9d1d-a21d35a17788 req-edc38c81-be8f-4f9f-aa9a-3c139bc5fb02 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0503666 Dec 08 11:36:25.603702 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4a1cdfb9-f783-4d83-9d1d-a21d35a17788 req-a87dd4f4-8352-4630-a7fc-4d179d02f3af tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0553355 Dec 08 11:36:25.663188 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-41d05ca9-5d05-4d53-9827-da3306e0afeb req-f32b7e15-182a-4e5a-9f5c-4285fd50c450 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=f4f33a56-55e3-4bc1-a952-b90b6fde964c HTTP/1.1" status: 200 len: 210 time: 0.0369194 Dec 08 11:36:25.709753 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['96b6dc81-7654-48f5-ac3f-e3e4d35982b3', 'ec0c1efb-b1b3-47b8-91c5-b30707a7222f'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:36:25.791617 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:26.239760 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f4f33a56-55e3-4bc1-a952-b90b6fde964c', 'name': 'network-vif-deleted', 'tag': 'ec0c1efb-b1b3-47b8-91c5-b30707a7222f'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:36:26.242180 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a4d3e85e-ae7e-45f7-bf97-707ef77b3b3d" -d '{"events": [{"server_uuid": "f4f33a56-55e3-4bc1-a952-b90b6fde964c", "name": "network-vif-deleted", "tag": "ec0c1efb-b1b3-47b8-91c5-b30707a7222f"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:36:26.335065 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:36:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85e28ac8-b119-4e4c-802b-e235e175de70 x-openstack-request-id: req-85e28ac8-b119-4e4c-802b-e235e175de70 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:36:26.335357 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f4f33a56-55e3-4bc1-a952-b90b6fde964c", "name": "network-vif-deleted", "tag": "ec0c1efb-b1b3-47b8-91c5-b30707a7222f", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:36:26.335610 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-85e28ac8-b119-4e4c-802b-e235e175de70 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:36:26.336053 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f4f33a56-55e3-4bc1-a952-b90b6fde964c', 'name': 'network-vif-deleted', 'tag': 'ec0c1efb-b1b3-47b8-91c5-b30707a7222f', 'status': 'completed', 'code': 200} Dec 08 11:36:26.548900 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 222531bb-d35b-49bb-b52a-9b0f529866e2 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:36:26.571130 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 222531bb-d35b-49bb-b52a-9b0f529866e2 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:36:26.571468 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 222531bb-d35b-49bb-b52a-9b0f529866e2 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:36:26.749900 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9138a200-1909-4911-bf14-7643d4e73202 req-3757c7ba-3744-4314-b003-62d498198193 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:26.751510 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9138a200-1909-4911-bf14-7643d4e73202 req-3757c7ba-3744-4314-b003-62d498198193 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0520475 Dec 08 11:36:26.801528 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9138a200-1909-4911-bf14-7643d4e73202 req-85d8f062-96f5-4265-8fea-b9a9a854cdcd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436656 Dec 08 11:36:26.941634 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b6eb79-3ecf-44af-ae18-186c941f710a req-7e12a4d4-8dbc-4c7a-8bf9-cf00a88b5395 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:26.943090 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a5b6eb79-3ecf-44af-ae18-186c941f710a req-7e12a4d4-8dbc-4c7a-8bf9-cf00a88b5395 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0517800 Dec 08 11:36:26.991200 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a5b6eb79-3ecf-44af-ae18-186c941f710a req-86773226-d4bc-46d5-afaf-b6d82c9fda30 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420129 Dec 08 11:36:27.053166 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33e38105-98c8-4417-ab8a-d736762c896c req-58b372eb-0d63-4f68-8402-fead055b0de5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:27.054638 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33e38105-98c8-4417-ab8a-d736762c896c req-58b372eb-0d63-4f68-8402-fead055b0de5 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 945 time: 0.0580688 Dec 08 11:36:27.102013 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33e38105-98c8-4417-ab8a-d736762c896c req-6d94cb99-e071-4c23-be6b-f6f6ac1af14c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413549 Dec 08 11:36:27.136736 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:27.920223 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d17532fd-a57e-473b-aafc-4be748b3ff71 req-3a6767e3-199b-466a-88e8-df4e87f48a79 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:27.921683 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d17532fd-a57e-473b-aafc-4be748b3ff71 req-3a6767e3-199b-466a-88e8-df4e87f48a79 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0475109 Dec 08 11:36:27.966573 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d17532fd-a57e-473b-aafc-4be748b3ff71 req-06997e8d-6e1e-4199-8744-7f48f9ebc6e0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389240 Dec 08 11:36:28.104785 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488e62ed-19a4-4383-899c-b49c2183c045 req-76ecdfc4-37f8-4e47-aecc-8739d51196af tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:28.106267 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-488e62ed-19a4-4383-899c-b49c2183c045 req-76ecdfc4-37f8-4e47-aecc-8739d51196af tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0479777 Dec 08 11:36:28.157248 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-488e62ed-19a4-4383-899c-b49c2183c045 req-024b7d49-73ce-4a23-881d-2e0f9b05db95 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450604 Dec 08 11:36:28.164873 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:28.219969 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d983edc4-699a-44df-8c75-c3f6375a5030 req-0064aa00-448e-4916-ba68-98c2f0efb712 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:28.221379 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d983edc4-699a-44df-8c75-c3f6375a5030 req-0064aa00-448e-4916-ba68-98c2f0efb712 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 945 time: 0.0482278 Dec 08 11:36:28.268966 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d983edc4-699a-44df-8c75-c3f6375a5030 req-0c63a206-9836-42eb-97f9-9bbdb005b095 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415695 Dec 08 11:36:28.556900 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device ec0c1efb-b1b3-47b8-91c5-b30707a7222f no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:36:28.576793 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: ec0c1efb-b1b3-47b8-91c5-b30707a7222f {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:36:28.577136 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device ec0c1efb-b1b3-47b8-91c5-b30707a7222f not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:36:29.083617 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed0e75d7-c9f6-4363-8227-8d0c7cac01d6 req-0741ecd3-0345-4a83-a322-3a525b8ccf6f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:29.085141 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ed0e75d7-c9f6-4363-8227-8d0c7cac01d6 req-0741ecd3-0345-4a83-a322-3a525b8ccf6f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0483468 Dec 08 11:36:29.137229 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ed0e75d7-c9f6-4363-8227-8d0c7cac01d6 req-26ca95ae-8edd-4e9a-92d8-caf790efedf7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453215 Dec 08 11:36:29.282156 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26dfc568-5861-4f00-865c-4182175ec499 req-50e4e592-a5c7-4b10-b02e-1dcac746a53c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:29.284261 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-26dfc568-5861-4f00-865c-4182175ec499 req-50e4e592-a5c7-4b10-b02e-1dcac746a53c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0552022 Dec 08 11:36:29.336444 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-26dfc568-5861-4f00-865c-4182175ec499 req-5bad34e5-3904-489e-a37f-da47cdda2388 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444040 Dec 08 11:36:29.387603 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daa062ee-9bfb-49a0-a057-60549270b333 req-209481e3-9c13-477f-9ebf-bd69b14c15b7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:29.389068 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-daa062ee-9bfb-49a0-a057-60549270b333 req-209481e3-9c13-477f-9ebf-bd69b14c15b7 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 945 time: 0.0493898 Dec 08 11:36:29.475446 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd56ff4b-d51a-47af-a1db-9e265d019f58 req-a7fc5eed-9faa-4877-97eb-1965a31bbf3b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:29.476925 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd56ff4b-d51a-47af-a1db-9e265d019f58 req-a7fc5eed-9faa-4877-97eb-1965a31bbf3b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0855739 Dec 08 11:36:29.480502 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-daa062ee-9bfb-49a0-a057-60549270b333 req-13e3cee2-ffd7-45af-9e46-6dd90d53f1af tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0802805 Dec 08 11:36:29.555084 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a16120-c3bb-4c11-8e18-f8c92a60365e req-4a99d30d-4c07-4c3d-a22a-9d42ec332530 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:29.556466 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-03a16120-c3bb-4c11-8e18-f8c92a60365e req-4a99d30d-4c07-4c3d-a22a-9d42ec332530 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=3102b9c0f7ea45048750ae3c81085631&device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 1138 time: 0.1535039 Dec 08 11:36:29.567107 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bd56ff4b-d51a-47af-a1db-9e265d019f58 req-0d2654ef-9b6e-4b45-b1d2-9e37a9f8e301 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0779450 Dec 08 11:36:29.651341 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a16120-c3bb-4c11-8e18-f8c92a60365e req-f3cc5a80-45fa-42de-b486-06c614678f2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:29.652793 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-03a16120-c3bb-4c11-8e18-f8c92a60365e req-f3cc5a80-45fa-42de-b486-06c614678f2a service neutron] 10.222.0.61 "GET /v2.0/networks?id=f5a54297-6b64-4f71-b9f2-2f9c14a03187 HTTP/1.1" status: 200 len: 915 time: 0.0848310 Dec 08 11:36:29.717935 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-03a16120-c3bb-4c11-8e18-f8c92a60365e req-1712764b-7da3-4ad2-90f5-3efca9086e10 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec HTTP/1.1" status: 200 len: 1001 time: 0.0564883 Dec 08 11:36:29.766852 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a16120-c3bb-4c11-8e18-f8c92a60365e req-e8db2f1f-84f8-447f-a654-b82304825cce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:29.769015 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-03a16120-c3bb-4c11-8e18-f8c92a60365e req-e8db2f1f-84f8-447f-a654-b82304825cce service neutron] 10.222.0.61 "GET /v2.0/subnets?id=07f39602-a4ed-4df9-a6e2-9c0943b66135 HTTP/1.1" status: 200 len: 853 time: 0.0417936 Dec 08 11:36:29.862905 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a16120-c3bb-4c11-8e18-f8c92a60365e req-7bcc46b0-1389-494c-b765-269d057904ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:29.864388 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-03a16120-c3bb-4c11-8e18-f8c92a60365e req-7bcc46b0-1389-494c-b765-269d057904ae service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=f5a54297-6b64-4f71-b9f2-2f9c14a03187&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0718627 Dec 08 11:36:29.872542 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 req-08ca897b-918a-4b99-b9d2-898fe1373d02 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:29.874114 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 req-08ca897b-918a-4b99-b9d2-898fe1373d02 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 945 time: 0.0726781 Dec 08 11:36:30.016210 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-03a16120-c3bb-4c11-8e18-f8c92a60365e req-5d3b203d-989c-4826-a955-621f32b4912e service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1411567 Dec 08 11:36:30.040180 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 req-64d19485-c819-4fc0-bfb7-46ff25030525 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Deleting port be511646-f492-43f2-af08-bc641afcd8a2 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:36:30.040516 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 req-64d19485-c819-4fc0-bfb7-46ff25030525 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:30.185511 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 req-64d19485-c819-4fc0-bfb7-46ff25030525 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] For port be511646-f492-43f2-af08-bc641afcd8a2, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=be511646-f492-43f2-af08-bc641afcd8a2,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:36:30.186102 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 req-64d19485-c819-4fc0-bfb7-46ff25030525 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:30.190095 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-03a16120-c3bb-4c11-8e18-f8c92a60365e req-203c3bf9-da5b-4898-bc8c-2000bc0d779a service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1604352 Dec 08 11:36:30.200203 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 req-64d19485-c819-4fc0-bfb7-46ff25030525 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling delete_port for be511646-f492-43f2-af08-bc641afcd8a2 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:36:30.312085 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9de4b64-64f4-40f0-bd46-fe4c9ba449dd req-0b95d9cd-02d9-407a-838f-d1a53224c9b9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:30.313611 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c9de4b64-64f4-40f0-bd46-fe4c9ba449dd req-0b95d9cd-02d9-407a-838f-d1a53224c9b9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 944 time: 0.0708199 Dec 08 11:36:30.397498 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c9de4b64-64f4-40f0-bd46-fe4c9ba449dd req-edc75c07-0823-49c3-b05d-b6c6194e4090 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0780134 Dec 08 11:36:30.403185 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 req-64d19485-c819-4fc0-bfb7-46ff25030525 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:30.416426 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['d9ecab87-157e-4ccb-8423-2248bb8451ea', '1d5f08a0-9b25-48d8-a2ed-88647aec1670', 'be511646-f492-43f2-af08-bc641afcd8a2'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:36:30.459952 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64d19485-c819-4fc0-bfb7-46ff25030525 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Pushing event deleted for resources: {'Port': ['ID=be511646-f492-43f2-af08-bc641afcd8a2,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:30.503844 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 req-64d19485-c819-4fc0-bfb7-46ff25030525 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] No DVR routers for this DVR port be511646-f492-43f2-af08-bc641afcd8a2 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:36:30.507051 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 req-64d19485-c819-4fc0-bfb7-46ff25030525 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:30.510470 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b5bac062-6f5e-4bdb-93c1-b98b07372f12 req-64d19485-c819-4fc0-bfb7-46ff25030525 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "DELETE /v2.0/ports/be511646-f492-43f2-af08-bc641afcd8a2 HTTP/1.1" status: 204 len: 173 time: 0.6273770 Dec 08 11:36:30.510934 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '01a3f1c2-c5b6-4500-89f8-03ff7a2c4321', 'name': 'network-vif-deleted', 'tag': 'be511646-f492-43f2-af08-bc641afcd8a2'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:36:30.513260 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-23b4030e-54d1-43ef-8d50-abe195167613" -d '{"events": [{"server_uuid": "01a3f1c2-c5b6-4500-89f8-03ff7a2c4321", "name": "network-vif-deleted", "tag": "be511646-f492-43f2-af08-bc641afcd8a2"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:36:30.527891 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03b3ba6c-1faf-4149-a9e6-97e7c7fca6a3 req-692a8b69-71c1-4da1-a7dd-ccd02165ceda tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:30.529645 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-03b3ba6c-1faf-4149-a9e6-97e7c7fca6a3 req-692a8b69-71c1-4da1-a7dd-ccd02165ceda tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.1179228 Dec 08 11:36:30.600349 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e48876bc-9cbc-403e-bd50-1a8704cc4805 req-7aa49c21-2439-4654-812e-3eec9958b22f tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=01a3f1c2-c5b6-4500-89f8-03ff7a2c4321 HTTP/1.1" status: 200 len: 210 time: 0.0335560 Dec 08 11:36:30.630368 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:36:30.642033 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-03b3ba6c-1faf-4149-a9e6-97e7c7fca6a3 req-3e8761f4-740b-44b5-9d3a-8fdcdbef9cdc tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1030495 Dec 08 11:36:30.651979 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:36:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-af0fd7c0-1d83-4985-81c7-034b6d2dc477 x-openstack-request-id: req-af0fd7c0-1d83-4985-81c7-034b6d2dc477 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:36:30.652578 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "01a3f1c2-c5b6-4500-89f8-03ff7a2c4321", "name": "network-vif-deleted", "tag": "be511646-f492-43f2-af08-bc641afcd8a2", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:36:30.653016 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-af0fd7c0-1d83-4985-81c7-034b6d2dc477 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:36:30.653713 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '01a3f1c2-c5b6-4500-89f8-03ff7a2c4321', 'name': 'network-vif-deleted', 'tag': 'be511646-f492-43f2-af08-bc641afcd8a2', 'status': 'completed', 'code': 200} Dec 08 11:36:30.748643 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a0865eb-ede4-4677-80b5-a9818f96e4c0 req-56ff846e-c81e-498e-9783-3917f49c5838 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:30.750183 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8a0865eb-ede4-4677-80b5-a9818f96e4c0 req-56ff846e-c81e-498e-9783-3917f49c5838 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0521264 Dec 08 11:36:30.798126 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:36:30.810757 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8a0865eb-ede4-4677-80b5-a9818f96e4c0 req-22ecb374-c276-4513-b8cb-5b0b897896e6 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0539854 Dec 08 11:36:30.826240 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'port_id': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'mac_address': 'fa:16:3e:f5:f7:79', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 278, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:36:30.906391 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:30.924007 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:36:30.946412 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:36:30.950135 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:30.994495 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,revision_number=9']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:31.001512 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:31.002471 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:31.002830 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:31.003173 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:31.003493 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:31.003818 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:31.004140 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:31.004460 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:31.004788 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:31.005114 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:31.005464 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:31.005781 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:31.006098 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:31.516602 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7308122c-3fc3-49ac-8edb-8ec48a767d76 req-4c72c04c-3900-48f9-abf0-c9d31cc9c136 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:31.518614 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7308122c-3fc3-49ac-8edb-8ec48a767d76 req-4c72c04c-3900-48f9-abf0-c9d31cc9c136 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 945 time: 0.0486758 Dec 08 11:36:31.564384 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7308122c-3fc3-49ac-8edb-8ec48a767d76 req-622b6ce0-2f48-40aa-977b-80c643af58c1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398481 Dec 08 11:36:31.739677 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['2ebdbac7-6fba-4bd2-bbec-7e49216db3fe'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:36:31.792476 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09bd509f-0384-4d20-89c2-ae670ce50e8f req-273f9702-499b-4afb-bfad-05d190eb3f24 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:31.794654 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-09bd509f-0384-4d20-89c2-ae670ce50e8f req-273f9702-499b-4afb-bfad-05d190eb3f24 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0687888 Dec 08 11:36:31.876230 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-09bd509f-0384-4d20-89c2-ae670ce50e8f req-bd2452e1-6929-45d0-b1a2-7ac5a1f1e088 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0746176 Dec 08 11:36:31.899129 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e33af474-356d-4feb-aa86-2696966dcf5b req-2dcd3122-878e-4981-9a21-25e05af10be0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:31.900709 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e33af474-356d-4feb-aa86-2696966dcf5b req-2dcd3122-878e-4981-9a21-25e05af10be0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 945 time: 0.0601861 Dec 08 11:36:31.952791 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e33af474-356d-4feb-aa86-2696966dcf5b req-d1e0b50e-cb92-4287-a328-eb56ff501a23 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445044 Dec 08 11:36:32.006857 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4608c2b-47fa-4f42-8ea7-e98a2054d645 req-d18f91e2-412d-4cb8-aaf9-e25d1a45e4a2 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:32.008459 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d4608c2b-47fa-4f42-8ea7-e98a2054d645 req-d18f91e2-412d-4cb8-aaf9-e25d1a45e4a2 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0490174 Dec 08 11:36:32.071785 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d4608c2b-47fa-4f42-8ea7-e98a2054d645 req-833bd468-887a-4e8a-8e84-8832746647db tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0568774 Dec 08 11:36:32.683477 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93cf7277-9cb6-4b56-955d-1f7b968cbb95 req-e6d1b0ca-8c94-4c1d-8c8a-5029c58e8957 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:32.684964 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-93cf7277-9cb6-4b56-955d-1f7b968cbb95 req-e6d1b0ca-8c94-4c1d-8c8a-5029c58e8957 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 945 time: 0.0496173 Dec 08 11:36:32.730291 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-93cf7277-9cb6-4b56-955d-1f7b968cbb95 req-3743fff8-e9f0-412a-a467-fa71d4e0fb6e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394874 Dec 08 11:36:32.992105 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc8eb87b-c834-4724-b867-7b65790ede04 req-579b3ba1-6095-4930-b329-eafc98219691 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:32.993650 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc8eb87b-c834-4724-b867-7b65790ede04 req-579b3ba1-6095-4930-b329-eafc98219691 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0491757 Dec 08 11:36:33.070399 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc8eb87b-c834-4724-b867-7b65790ede04 req-a8d0d22b-dfd3-46e6-a0c2-e5780acf9647 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703609 Dec 08 11:36:33.091556 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e092af76-a1b9-407b-b67e-953bb1173c15 req-acdaad5e-0cf1-4b06-8c27-0b1bf81773dd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:33.104613 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e092af76-a1b9-407b-b67e-953bb1173c15 req-acdaad5e-0cf1-4b06-8c27-0b1bf81773dd tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 945 time: 0.0738389 Dec 08 11:36:33.161443 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e092af76-a1b9-407b-b67e-953bb1173c15 req-5cceed18-ee65-470e-8c91-50cbae7ec0fe tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589747 Dec 08 11:36:33.225891 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f661d2b0-e8cc-47a5-872f-17bafb9a29d6 req-c2a68607-5e22-4947-bab8-86dd14a5b31b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:33.227623 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f661d2b0-e8cc-47a5-872f-17bafb9a29d6 req-c2a68607-5e22-4947-bab8-86dd14a5b31b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0649755 Dec 08 11:36:33.285997 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f661d2b0-e8cc-47a5-872f-17bafb9a29d6 req-60e36e79-d3af-4a87-a732-e1a88a4d335f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0523460 Dec 08 11:36:33.847887 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826aea66-a86e-4002-bd9f-6312ca11de8e req-53cd4bb8-724d-4a6d-8b40-513e38c9bf1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:33.849340 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-826aea66-a86e-4002-bd9f-6312ca11de8e req-53cd4bb8-724d-4a6d-8b40-513e38c9bf1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 945 time: 0.0470686 Dec 08 11:36:33.898823 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-826aea66-a86e-4002-bd9f-6312ca11de8e req-7c253dba-7c94-4c3c-9107-7e2e78124fc9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436666 Dec 08 11:36:34.201017 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bf363a5-e20f-4b7c-acf3-53ab84bca2bc req-d8edf543-75da-4314-9cd3-788783700849 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:34.202560 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4bf363a5-e20f-4b7c-acf3-53ab84bca2bc req-d8edf543-75da-4314-9cd3-788783700849 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0529671 Dec 08 11:36:34.277686 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4bf363a5-e20f-4b7c-acf3-53ab84bca2bc req-f6a53c89-56fc-493a-a5c9-173afe4544c5 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0685623 Dec 08 11:36:34.288398 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faceb7c5-3501-49cf-920c-14f3da114fc5 req-4cf8e972-bc27-4b0b-b0aa-b962c149fe22 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:34.289871 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-faceb7c5-3501-49cf-920c-14f3da114fc5 req-4cf8e972-bc27-4b0b-b0aa-b962c149fe22 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 945 time: 0.0679929 Dec 08 11:36:34.336570 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-faceb7c5-3501-49cf-920c-14f3da114fc5 req-863f65f2-f827-4642-b0db-893dfab379a0 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408912 Dec 08 11:36:34.400740 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-539edc37-ee75-4feb-ba26-521b48587cf9 req-fbab6f16-1d7e-4a5c-9b5b-ccca8220ccef tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:34.402194 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-539edc37-ee75-4feb-ba26-521b48587cf9 req-fbab6f16-1d7e-4a5c-9b5b-ccca8220ccef tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0513089 Dec 08 11:36:34.460088 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-539edc37-ee75-4feb-ba26-521b48587cf9 req-3b4b748c-7c36-4168-9d2d-982c8901af7c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0513170 Dec 08 11:36:35.023167 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37760cb2-7425-4d43-9517-426f1be35cf7 req-61436a9e-b994-47c3-adf9-3f19a9d0dad9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:35.025031 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-37760cb2-7425-4d43-9517-426f1be35cf7 req-61436a9e-b994-47c3-adf9-3f19a9d0dad9 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 945 time: 0.0543313 Dec 08 11:36:35.071690 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-37760cb2-7425-4d43-9517-426f1be35cf7 req-06e215ff-d032-4a60-90ee-0928ca232ed8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409267 Dec 08 11:36:35.394225 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fad8422d-07de-47dd-aea7-8bf1602f8a93 req-8e386551-f71d-426d-848e-0cda887a21db tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:35.395714 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fad8422d-07de-47dd-aea7-8bf1602f8a93 req-8e386551-f71d-426d-848e-0cda887a21db tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0523946 Dec 08 11:36:35.472522 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fad8422d-07de-47dd-aea7-8bf1602f8a93 req-ce7af5bf-35a4-4630-8220-13d63bbeb36c tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689950 Dec 08 11:36:35.480587 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4fb84cd-a1cf-474e-a276-20300b650d1c req-4d3da671-86b7-4bae-b464-83b449476f2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:35.482045 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4fb84cd-a1cf-474e-a276-20300b650d1c req-4d3da671-86b7-4bae-b464-83b449476f2e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 945 time: 0.0803266 Dec 08 11:36:35.545561 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4fb84cd-a1cf-474e-a276-20300b650d1c req-0288ea1e-e4fc-4a6f-804d-1722dfd7814b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537245 Dec 08 11:36:35.580505 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503a0b40-b38b-435c-9b5c-161b66a7be99 req-6cc9c152-adb5-46b5-8e8a-64261b893816 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:35.581999 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-503a0b40-b38b-435c-9b5c-161b66a7be99 req-6cc9c152-adb5-46b5-8e8a-64261b893816 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0529823 Dec 08 11:36:35.643385 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-503a0b40-b38b-435c-9b5c-161b66a7be99 req-d2a1ad15-880a-466d-af66-8bc53226646b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0554218 Dec 08 11:36:36.190430 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-813040ee-f8c3-45c3-b38d-b7c4ba692255 req-2719e0aa-a56e-427a-9e01-cbb0d8c2c4f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:36.191956 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-813040ee-f8c3-45c3-b38d-b7c4ba692255 req-2719e0aa-a56e-427a-9e01-cbb0d8c2c4f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 945 time: 0.0487390 Dec 08 11:36:36.238699 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-813040ee-f8c3-45c3-b38d-b7c4ba692255 req-1542f875-1e20-4af9-a220-8ad0908f382d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406945 Dec 08 11:36:36.585954 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54753fbb-a9e1-4541-8020-90110c1084ca req-70dd48fb-4852-431e-b9fd-8f92ae5fc4a3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:36.587425 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-54753fbb-a9e1-4541-8020-90110c1084ca req-70dd48fb-4852-431e-b9fd-8f92ae5fc4a3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0473294 Dec 08 11:36:36.590470 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:36:36.640800 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:36:36.641199 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:36.662985 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-54753fbb-a9e1-4541-8020-90110c1084ca req-90d0925f-69de-4f0e-9b49-de82714ea0b3 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688722 Dec 08 11:36:36.681341 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d3a4c2c-5bc4-4ea9-8229-c7b04937e628 req-12d8fd2d-38bc-4f14-b9ca-660d8d2ccf40 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:36.682956 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4d3a4c2c-5bc4-4ea9-8229-c7b04937e628 req-12d8fd2d-38bc-4f14-b9ca-660d8d2ccf40 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 945 time: 0.0700369 Dec 08 11:36:36.725017 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:36.747836 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:36:36.750267 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b97512bb-2b11-439f-adf0-00c6db9832f2" -d '{"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-plugged", "status": "completed", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:36:36.750589 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4d3a4c2c-5bc4-4ea9-8229-c7b04937e628 req-2b4c4659-ae8c-4787-9f6e-68ab3e820c3c tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560589 Dec 08 11:36:36.763917 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:36:36.768437 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:36.769491 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device be511646-f492-43f2-af08-bc641afcd8a2 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:36:36.799534 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a731f820-b757-4ea7-9881-dd0ffff5de5c req-40503d38-e19f-43fe-9664-bc3873bf641b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:36.801002 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a731f820-b757-4ea7-9881-dd0ffff5de5c req-40503d38-e19f-43fe-9664-bc3873bf641b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0711651 Dec 08 11:36:36.812878 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: be511646-f492-43f2-af08-bc641afcd8a2 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:36:36.813258 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device be511646-f492-43f2-af08-bc641afcd8a2 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:36:36.818984 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:36:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c04a4af9-f1d5-4538-b348-536072a7e7c2 x-openstack-request-id: req-c04a4af9-f1d5-4538-b348-536072a7e7c2 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:36:36.819289 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-plugged", "status": "completed", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:36:36.819546 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-c04a4af9-f1d5-4538-b348-536072a7e7c2 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:36:36.819932 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'code': 200} Dec 08 11:36:36.842957 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,revision_number=10']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:36.867946 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a731f820-b757-4ea7-9881-dd0ffff5de5c req-15feffa5-5cec-48a5-8107-502eedf8848a tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0604680 Dec 08 11:36:37.357495 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8cba448-c23c-4f66-a110-46d3978cc6ff req-840fe41e-dba0-4d65-96ee-419b9841ff5a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:37.358835 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e8cba448-c23c-4f66-a110-46d3978cc6ff req-840fe41e-dba0-4d65-96ee-419b9841ff5a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.0466106 Dec 08 11:36:37.408618 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e8cba448-c23c-4f66-a110-46d3978cc6ff req-2c3c811c-1286-4305-87d1-94fb6261063b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433452 Dec 08 11:36:37.775626 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d37ab16a-6dff-4814-ac49-9de01d49f6ff req-f4309f5a-2ae6-45ef-b3ad-c36ab40bb40b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:37.777118 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d37ab16a-6dff-4814-ac49-9de01d49f6ff req-f4309f5a-2ae6-45ef-b3ad-c36ab40bb40b tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0483198 Dec 08 11:36:37.832162 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d37ab16a-6dff-4814-ac49-9de01d49f6ff req-343e4ad7-a4c8-42be-8b90-78b49201c2af tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492249 Dec 08 11:36:37.869881 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fd38092-968e-44e4-bf22-bba65c12cda0 req-e0f21d9f-4b67-49bf-abba-b66dc7d822ee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:37.871338 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0fd38092-968e-44e4-bf22-bba65c12cda0 req-e0f21d9f-4b67-49bf-abba-b66dc7d822ee tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 945 time: 0.0549042 Dec 08 11:36:37.918682 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0fd38092-968e-44e4-bf22-bba65c12cda0 req-026659e7-2d3f-4522-b5b2-92921335e64b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409131 Dec 08 11:36:37.982861 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cda2edd7-6a5a-4e8b-a044-9291ca005cf1 req-78f4b667-13c0-4436-bacf-998ca1ddbe1b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:37.984220 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cda2edd7-6a5a-4e8b-a044-9291ca005cf1 req-78f4b667-13c0-4436-bacf-998ca1ddbe1b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0508001 Dec 08 11:36:38.042739 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cda2edd7-6a5a-4e8b-a044-9291ca005cf1 req-0445d412-2295-430b-8317-8746ab5cba5f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0524380 Dec 08 11:36:38.529420 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cf16a7d-4195-4a96-801f-08ee728a48f3 req-33c13163-ff58-4fe0-9384-771644633a35 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:38.530784 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7cf16a7d-4195-4a96-801f-08ee728a48f3 req-33c13163-ff58-4fe0-9384-771644633a35 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.0477359 Dec 08 11:36:38.576097 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7cf16a7d-4195-4a96-801f-08ee728a48f3 req-c11a74eb-b1d0-4f03-989d-f4ea94a55f06 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389340 Dec 08 11:36:38.895854 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:36:38.951491 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-562d028f-d6f1-46d4-912b-3890017f4659 req-221930c9-aef4-4bee-a303-fdf522388f5d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:38.952971 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-562d028f-d6f1-46d4-912b-3890017f4659 req-221930c9-aef4-4bee-a303-fdf522388f5d tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.0508971 Dec 08 11:36:39.023441 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-562d028f-d6f1-46d4-912b-3890017f4659 req-11797fb4-a291-4e38-b948-04242b682705 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646195 Dec 08 11:36:39.043289 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace33f38-8bb4-4342-8ff6-be18682d6f3e req-ec34ac18-4665-44eb-9c6b-500d01237d72 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:39.044780 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ace33f38-8bb4-4342-8ff6-be18682d6f3e req-ec34ac18-4665-44eb-9c6b-500d01237d72 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 945 time: 0.0611746 Dec 08 11:36:39.091103 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ace33f38-8bb4-4342-8ff6-be18682d6f3e req-6e0bf6d2-a2d0-4df7-a5e3-62890f599c79 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404267 Dec 08 11:36:39.154201 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8124738-6146-4581-9047-c9627e982f91 req-80f4efe7-92ff-418d-a37f-287e73e0e223 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:39.155546 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8124738-6146-4581-9047-c9627e982f91 req-80f4efe7-92ff-418d-a37f-287e73e0e223 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0473173 Dec 08 11:36:39.221427 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8124738-6146-4581-9047-c9627e982f91 req-fc32bd48-2774-4d3c-96e7-f7fc770a5dff tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0592685 Dec 08 11:36:39.463360 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 req-0869fd45-6e18-4ab4-bc19-244215740033 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:39.464681 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 req-0869fd45-6e18-4ab4-bc19-244215740033 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 945 time: 0.0476384 Dec 08 11:36:39.565880 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 req-42576175-6b19-4428-97f6-3dc123d6584a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Deleting port 1d5f08a0-9b25-48d8-a2ed-88647aec1670 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:36:39.566574 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 req-42576175-6b19-4428-97f6-3dc123d6584a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:39.664947 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 req-42576175-6b19-4428-97f6-3dc123d6584a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] For port 1d5f08a0-9b25-48d8-a2ed-88647aec1670, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=1d5f08a0-9b25-48d8-a2ed-88647aec1670,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:36:39.665334 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 req-42576175-6b19-4428-97f6-3dc123d6584a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:39.691965 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 req-42576175-6b19-4428-97f6-3dc123d6584a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling delete_port for 1d5f08a0-9b25-48d8-a2ed-88647aec1670 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:36:39.747773 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-670cbbe3-68b6-46ea-b413-5fd2a1c4b198 req-9da4205c-947a-4c62-b0de-107bf9c6652d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:39.749124 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-670cbbe3-68b6-46ea-b413-5fd2a1c4b198 req-9da4205c-947a-4c62-b0de-107bf9c6652d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.0988457 Dec 08 11:36:40.164212 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-670cbbe3-68b6-46ea-b413-5fd2a1c4b198 req-1a2f134e-8981-47f7-b1a5-17920d8a4e52 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4080186 Dec 08 11:36:40.184457 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43e4d573-87ef-45a7-8e29-105fb8c5e69b req-0012f8fc-6498-4e00-8ddb-231b24a46fc4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:40.185958 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-43e4d573-87ef-45a7-8e29-105fb8c5e69b req-0012f8fc-6498-4e00-8ddb-231b24a46fc4 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.61 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.1477187 Dec 08 11:36:40.305398 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81e49a30-9f64-459a-9724-13757a7eead6 req-9110e306-dd5f-48f0-b6c0-4180bdd92003 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:40.306774 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-81e49a30-9f64-459a-9724-13757a7eead6 req-9110e306-dd5f-48f0-b6c0-4180bdd92003 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 945 time: 0.2082176 Dec 08 11:36:40.320743 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3e0669b-c6a1-4aed-b231-6a75ab746b05 req-4ccdccc4-f143-499a-a227-0e8c529c4909 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:40.322189 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e3e0669b-c6a1-4aed-b231-6a75ab746b05 req-4ccdccc4-f143-499a-a227-0e8c529c4909 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 1100 time: 0.2011924 Dec 08 11:36:40.349340 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 req-42576175-6b19-4428-97f6-3dc123d6584a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:40.361057 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['d9ecab87-157e-4ccb-8423-2248bb8451ea', '1d5f08a0-9b25-48d8-a2ed-88647aec1670'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:36:40.412641 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42576175-6b19-4428-97f6-3dc123d6584a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Pushing event deleted for resources: {'Port': ['ID=1d5f08a0-9b25-48d8-a2ed-88647aec1670,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:40.451370 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a693b43c-e0e5-4740-81c2-4283bfe69f25 req-98ee6277-55b2-439a-a6cd-a5393191721d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:40.452592 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a693b43c-e0e5-4740-81c2-4283bfe69f25 req-98ee6277-55b2-439a-a6cd-a5393191721d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 867 time: 0.2049742 Dec 08 11:36:40.531077 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-81e49a30-9f64-459a-9724-13757a7eead6 req-63713d52-b689-4792-b151-805fe635cb27 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/security-groups?id=75bd5163-3e52-4a6c-84d2-db036e5fa483&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2141974 Dec 08 11:36:40.536595 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 req-42576175-6b19-4428-97f6-3dc123d6584a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] No DVR routers for this DVR port 1d5f08a0-9b25-48d8-a2ed-88647aec1670 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:36:40.542012 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e3e0669b-c6a1-4aed-b231-6a75ab746b05 req-546e167b-b140-43ed-92d5-fa098575c759 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1956732 Dec 08 11:36:40.543087 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 req-42576175-6b19-4428-97f6-3dc123d6584a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:40.548269 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f4a94de0-7d82-4a23-abe3-b7ec8fb45a37 req-42576175-6b19-4428-97f6-3dc123d6584a tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "DELETE /v2.0/ports/1d5f08a0-9b25-48d8-a2ed-88647aec1670 HTTP/1.1" status: 204 len: 173 time: 1.0655077 Dec 08 11:36:40.548481 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '96e47acb-aeed-4636-9a70-a1b987abaed6', 'name': 'network-vif-deleted', 'tag': '1d5f08a0-9b25-48d8-a2ed-88647aec1670'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:36:40.550835 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c4aab2ea-a6f2-46fb-8fee-9715196b45a9" -d '{"events": [{"server_uuid": "96e47acb-aeed-4636-9a70-a1b987abaed6", "name": "network-vif-deleted", "tag": "1d5f08a0-9b25-48d8-a2ed-88647aec1670"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:36:40.570914 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-43e4d573-87ef-45a7-8e29-105fb8c5e69b req-040913b0-0dd8-417a-9518-382247cd665e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Deleting port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:36:40.571583 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-43e4d573-87ef-45a7-8e29-105fb8c5e69b req-040913b0-0dd8-417a-9518-382247cd665e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:40.637344 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a693b43c-e0e5-4740-81c2-4283bfe69f25 req-d0188b33-5679-4751-9f42-4420f752cf59 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1768687 Dec 08 11:36:40.690753 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:36:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-31b2c8c8-b4e9-42d0-86ea-256ce60a8102 x-openstack-request-id: req-31b2c8c8-b4e9-42d0-86ea-256ce60a8102 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:36:40.691049 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "96e47acb-aeed-4636-9a70-a1b987abaed6", "name": "network-vif-deleted", "tag": "1d5f08a0-9b25-48d8-a2ed-88647aec1670", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:36:40.691306 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-31b2c8c8-b4e9-42d0-86ea-256ce60a8102 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:36:40.691699 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '96e47acb-aeed-4636-9a70-a1b987abaed6', 'name': 'network-vif-deleted', 'tag': '1d5f08a0-9b25-48d8-a2ed-88647aec1670', 'status': 'completed', 'code': 200} Dec 08 11:36:40.706698 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f68f6f-f85d-4e9a-b92e-bffdae71ba8f req-08a109c5-00a6-4dc5-b629-c381489c30e0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:40.708127 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-28f68f6f-f85d-4e9a-b92e-bffdae71ba8f req-08a109c5-00a6-4dc5-b629-c381489c30e0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.1113698 Dec 08 11:36:40.724646 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-43e4d573-87ef-45a7-8e29-105fb8c5e69b req-040913b0-0dd8-417a-9518-382247cd665e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] For port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=96b6dc81-7654-48f5-ac3f-e3e4d35982b3,segment=NetworkSegment(aa890c2f-8ce4-49b3-a366-4788a314e043),segment_id=aa890c2f-8ce4-49b3-a366-4788a314e043)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:36:40.725009 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-43e4d573-87ef-45a7-8e29-105fb8c5e69b req-040913b0-0dd8-417a-9518-382247cd665e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:40.745857 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-43e4d573-87ef-45a7-8e29-105fb8c5e69b req-040913b0-0dd8-417a-9518-382247cd665e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Calling delete_port for 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:36:40.825206 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-28f68f6f-f85d-4e9a-b92e-bffdae71ba8f req-dc5ef3f3-f1d9-4f96-829e-c965264b3800 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1099994 Dec 08 11:36:40.910756 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-43e4d573-87ef-45a7-8e29-105fb8c5e69b req-040913b0-0dd8-417a-9518-382247cd665e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:40.937700 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-040913b0-0dd8-417a-9518-382247cd665e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Pushing event deleted for resources: {'Port': ['ID=96b6dc81-7654-48f5-ac3f-e3e4d35982b3,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:40.979525 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-43e4d573-87ef-45a7-8e29-105fb8c5e69b req-040913b0-0dd8-417a-9518-382247cd665e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] No DVR routers for this DVR port 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:36:40.982696 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-43e4d573-87ef-45a7-8e29-105fb8c5e69b req-040913b0-0dd8-417a-9518-382247cd665e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:40.986016 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-43e4d573-87ef-45a7-8e29-105fb8c5e69b req-040913b0-0dd8-417a-9518-382247cd665e tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.61 "DELETE /v2.0/ports/96b6dc81-7654-48f5-ac3f-e3e4d35982b3 HTTP/1.1" status: 204 len: 173 time: 0.7753301 Dec 08 11:36:41.295136 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47936368-6b45-4b0c-89ad-a0bc28709df0 req-d749985c-2e30-4c30-9587-8e9796172bb5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:41.296602 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-47936368-6b45-4b0c-89ad-a0bc28709df0 req-d749985c-2e30-4c30-9587-8e9796172bb5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.0522320 Dec 08 11:36:41.342793 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-47936368-6b45-4b0c-89ad-a0bc28709df0 req-f90ee019-7d4c-4ce3-91d7-edb35c46e192 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394766 Dec 08 11:36:41.625794 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fb9c1c7e-5bc4-4258-9eb9-893660fd3231 req-98750be9-6b7b-47f0-80c9-b5d0af672051 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 210 time: 0.0256162 Dec 08 11:36:41.729874 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8d0e3dc3-5682-4fe8-bd8d-b73722c84bf2 req-e45af59b-6f68-421b-b1dc-1382ca2539e9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 210 time: 0.0253370 Dec 08 11:36:41.937756 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d8ca50-b488-4675-8488-1e10d8863fd1 req-14a26a80-7130-4ccb-a2e0-8a9292cf23a0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:41.939110 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f5d8ca50-b488-4675-8488-1e10d8863fd1 req-14a26a80-7130-4ccb-a2e0-8a9292cf23a0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0484757 Dec 08 11:36:42.000123 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f5d8ca50-b488-4675-8488-1e10d8863fd1 req-c4a96cf9-84e4-4f73-b2d5-0162ef370b86 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0551436 Dec 08 11:36:42.459904 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3acc7a1-32b0-42e2-905a-76d5cc10fa13 req-edfa5583-8586-4caa-937a-dc5a1b60f16a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:42.461364 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e3acc7a1-32b0-42e2-905a-76d5cc10fa13 req-edfa5583-8586-4caa-937a-dc5a1b60f16a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.0478752 Dec 08 11:36:42.506932 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e3acc7a1-32b0-42e2-905a-76d5cc10fa13 req-3f7b6131-1ae9-4198-94ca-8f6074dba046 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397210 Dec 08 11:36:42.698949 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ef74eb6c-4764-40c3-8610-e4f4bc3e610d', 'name': 'network-vif-deleted', 'tag': '96b6dc81-7654-48f5-ac3f-e3e4d35982b3'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:36:42.701071 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d4f3bb1-7170-4780-99f6-f71e2f433c5d" -d '{"events": [{"server_uuid": "ef74eb6c-4764-40c3-8610-e4f4bc3e610d", "name": "network-vif-deleted", "tag": "96b6dc81-7654-48f5-ac3f-e3e4d35982b3"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:36:42.720754 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-719ac464-7cab-4c44-9e3e-3c1c5d0eadc7 req-d04b094d-65a2-4e85-9c26-edb36fcd9067 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 210 time: 0.0302639 Dec 08 11:36:42.736085 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:36:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-55fff654-fc5b-4860-8461-9bb71f5e29d0 x-openstack-request-id: req-55fff654-fc5b-4860-8461-9bb71f5e29d0 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:36:42.736372 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ef74eb6c-4764-40c3-8610-e4f4bc3e610d", "name": "network-vif-deleted", "tag": "96b6dc81-7654-48f5-ac3f-e3e4d35982b3", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:36:42.736620 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-55fff654-fc5b-4860-8461-9bb71f5e29d0 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:36:42.736995 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ef74eb6c-4764-40c3-8610-e4f4bc3e610d', 'name': 'network-vif-deleted', 'tag': '96b6dc81-7654-48f5-ac3f-e3e4d35982b3', 'status': 'completed', 'code': 200} Dec 08 11:36:42.820943 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-03fb1b52-6487-4edc-913a-0b0ae1a507f6 req-7e367094-5443-42de-9492-3c2dd17b6890 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 210 time: 0.0248408 Dec 08 11:36:43.117278 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcbcbbbc-d3dc-4429-90c1-d2b6b18278c4 req-6a8d7dd6-1595-4d57-8598-e8d7d77122cf tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:43.118898 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bcbcbbbc-d3dc-4429-90c1-d2b6b18278c4 req-6a8d7dd6-1595-4d57-8598-e8d7d77122cf tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0517621 Dec 08 11:36:43.178826 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bcbcbbbc-d3dc-4429-90c1-d2b6b18278c4 req-9da5e9a8-718a-42ac-8d87-8e39101b9d13 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0531063 Dec 08 11:36:43.630780 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b07fa56-694f-429e-84d5-9d8aa59a52f6 req-f7b05fef-c7c8-4424-b015-19d1364a3a13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:43.632229 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b07fa56-694f-429e-84d5-9d8aa59a52f6 req-f7b05fef-c7c8-4424-b015-19d1364a3a13 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.0482717 Dec 08 11:36:43.678342 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b07fa56-694f-429e-84d5-9d8aa59a52f6 req-8092dad2-13a6-43db-b6d6-a55065effa55 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401225 Dec 08 11:36:43.812671 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8d522a49-b3f6-4ac0-9d51-e9992b332472 req-43623426-ff8f-46af-aa57-656003b7eda5 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 210 time: 0.0248632 Dec 08 11:36:43.924074 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bfff00d3-0c92-4feb-8883-b7dae715dca6 req-21db39e2-a208-4129-b51c-9f5ae132e6a6 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 210 time: 0.0279810 Dec 08 11:36:44.291989 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3994e7aa-b9df-4898-9a58-796dcf753a04 req-dca1e5c7-6f1b-4c96-a115-59e94af37abf tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:44.293488 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3994e7aa-b9df-4898-9a58-796dcf753a04 req-dca1e5c7-6f1b-4c96-a115-59e94af37abf tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0488403 Dec 08 11:36:44.351938 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3994e7aa-b9df-4898-9a58-796dcf753a04 req-007e0eab-111c-4324-b702-2066b5b98aea tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0523241 Dec 08 11:36:44.546756 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 1d5f08a0-9b25-48d8-a2ed-88647aec1670 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:36:44.567324 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 1d5f08a0-9b25-48d8-a2ed-88647aec1670 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:36:44.567678 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 1d5f08a0-9b25-48d8-a2ed-88647aec1670 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:36:44.568077 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:36:44.585864 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:36:44.586200 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 96b6dc81-7654-48f5-ac3f-e3e4d35982b3 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:36:44.796025 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbcb52cf-9f1f-4e8f-a4f4-9f39dc32215f req-2d9b508b-958a-47e5-b378-98ab8acf1cf2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:44.797459 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bbcb52cf-9f1f-4e8f-a4f4-9f39dc32215f req-2d9b508b-958a-47e5-b378-98ab8acf1cf2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.0488875 Dec 08 11:36:44.843707 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bbcb52cf-9f1f-4e8f-a4f4-9f39dc32215f req-24fbc35e-5cb2-43ed-b71d-18fc50219882 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402024 Dec 08 11:36:44.909041 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-40fa4750-91c7-4473-b448-45470e806935 req-13fedbde-b3c5-43f1-8bcc-a215ca7a7ed6 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 210 time: 0.0287559 Dec 08 11:36:45.024649 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d32613d3-a2f7-4504-8641-a2232fa093a7 req-62270297-b0a5-4c6e-abf0-6fd80f108781 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 210 time: 0.0262468 Dec 08 11:36:45.466924 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b08f8cf-5f28-4173-8ee4-9d0143e192c4 req-6114c3e8-09ce-4f00-8416-3a3e4c6f97ea tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:45.468365 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3b08f8cf-5f28-4173-8ee4-9d0143e192c4 req-6114c3e8-09ce-4f00-8416-3a3e4c6f97ea tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0492222 Dec 08 11:36:45.527534 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3b08f8cf-5f28-4173-8ee4-9d0143e192c4 req-bf4faf80-2449-42cb-a146-082533da5c2b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0531383 Dec 08 11:36:45.961406 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2732596-0c33-49e2-9eb5-da8b906cdc4a req-d692419f-7996-43b2-9f32-3854628d4c83 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:45.962865 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e2732596-0c33-49e2-9eb5-da8b906cdc4a req-d692419f-7996-43b2-9f32-3854628d4c83 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.0486515 Dec 08 11:36:46.008208 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2c77a58c-6afa-41a8-9df4-266a5734b002 req-38016705-1067-4e58-a6e5-d02a7cfec7db tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 210 time: 0.0337379 Dec 08 11:36:46.035139 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e2732596-0c33-49e2-9eb5-da8b906cdc4a req-05257db6-b85b-40ef-b9c0-016bf26bdb57 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0663934 Dec 08 11:36:46.132041 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5a794f84-8075-4f6d-b204-0f46fea9e861 req-557f0cc4-ffa8-43f6-bf69-b7fbb3708392 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=96e47acb-aeed-4636-9a70-a1b987abaed6 HTTP/1.1" status: 200 len: 210 time: 0.0275049 Dec 08 11:36:46.640535 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e55b41c-d9cf-4bd4-8734-6e7955ac4e55 req-be658782-eea3-470d-be69-65b774d89c42 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:46.642287 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8e55b41c-d9cf-4bd4-8734-6e7955ac4e55 req-be658782-eea3-470d-be69-65b774d89c42 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0481851 Dec 08 11:36:46.700873 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8e55b41c-d9cf-4bd4-8734-6e7955ac4e55 req-4d4e3c2f-f1c0-4929-9564-9a06aac38326 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0525575 Dec 08 11:36:47.113520 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-97175596-9b97-4143-b04e-0638bc1c8d63 req-34a99b56-4b43-4d29-8079-8bbf296acd70 tempest-ServerRescueNegativeTestJSON-1310061065 tempest-ServerRescueNegativeTestJSON-1310061065-project] 10.222.0.66 "GET /v2.0/ports?device_id=ef74eb6c-4764-40c3-8610-e4f4bc3e610d HTTP/1.1" status: 200 len: 210 time: 0.0292835 Dec 08 11:36:47.161687 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25b8c46c-65ac-4319-a215-f33f56a5ed5a req-61564b24-27ee-4269-9bb7-76f9269af5fa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:47.163072 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-25b8c46c-65ac-4319-a215-f33f56a5ed5a req-61564b24-27ee-4269-9bb7-76f9269af5fa tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.0486927 Dec 08 11:36:47.210529 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-25b8c46c-65ac-4319-a215-f33f56a5ed5a req-278df380-4c23-4a46-830d-3f31dc336702 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415452 Dec 08 11:36:47.594985 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:47.818485 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcef9af4-3b07-4f82-b168-44190dd70019 req-c001b902-bb8b-4c50-b995-d87b273d989c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:47.820096 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fcef9af4-3b07-4f82-b168-44190dd70019 req-c001b902-bb8b-4c50-b995-d87b273d989c tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0506735 Dec 08 11:36:47.882558 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fcef9af4-3b07-4f82-b168-44190dd70019 req-1a5225fc-def9-4b0c-aba7-d79700b29085 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0561085 Dec 08 11:36:48.174732 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55438) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:48.410409 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beee8526-ce2e-4b8a-847e-2cb7d514dd84 req-2252a90e-ebb5-44bd-a028-a6dae70116a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:48.411837 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-beee8526-ce2e-4b8a-847e-2cb7d514dd84 req-2252a90e-ebb5-44bd-a028-a6dae70116a8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.0927393 Dec 08 11:36:48.571222 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-beee8526-ce2e-4b8a-847e-2cb7d514dd84 req-5f2b894d-9eca-4f98-a349-163fb5bcd71a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1518617 Dec 08 11:36:48.622806 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0f942bd-f051-45cc-b0a2-c0b527ab8cd9 req-7b8e79aa-7cad-4a47-b70d-5e93499f0980 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:48.624260 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b0f942bd-f051-45cc-b0a2-c0b527ab8cd9 req-7b8e79aa-7cad-4a47-b70d-5e93499f0980 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 946 time: 0.1268733 Dec 08 11:36:48.715502 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b0f942bd-f051-45cc-b0a2-c0b527ab8cd9 req-94789267-27ef-4b93-b483-ed937aba72b9 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0850456 Dec 08 11:36:48.752923 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7897011'] for router_interface, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:49.039129 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c3ab9bf-1c5d-42cb-ae21-023fc7976e45 req-19641d7a-3d6c-4e76-845a-dbfefbd43e13 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:49.040486 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3c3ab9bf-1c5d-42cb-ae21-023fc7976e45 req-19641d7a-3d6c-4e76-845a-dbfefbd43e13 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0841906 Dec 08 11:36:49.365625 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3c3ab9bf-1c5d-42cb-ae21-023fc7976e45 req-ea30fb11-e3ac-48e1-9c6a-357464f55acb tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.3186476 Dec 08 11:36:49.371263 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Deleting port 56107fd6-be43-48a1-b2a0-e0180cab581a {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:36:49.371599 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:49.449072 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] For port 56107fd6-be43-48a1-b2a0-e0180cab581a, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=56107fd6-be43-48a1-b2a0-e0180cab581a,segment=NetworkSegment(aa890c2f-8ce4-49b3-a366-4788a314e043),segment_id=aa890c2f-8ce4-49b3-a366-4788a314e043)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:36:49.449487 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:49.462188 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Calling delete_port for 56107fd6-be43-48a1-b2a0-e0180cab581a owned by network:router_interface {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:36:49.643420 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:49.680782 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Pushing event deleted for resources: {'Port': ['ID=56107fd6-be43-48a1-b2a0-e0180cab581a,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:49.717179 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:49.717540 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:49.717879 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:49.718214 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:49.718542 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:49.718871 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:49.719198 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:49.719524 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:49.719849 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:49.720208 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:49.720528 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:49.720951 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:49.721217 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:49.814281 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07046a9a-f124-440d-9ad2-f6fb666f356c req-5bdb87d0-cd2b-403c-8b77-99e0c9e8cd49 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:49.815717 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-07046a9a-f124-440d-9ad2-f6fb666f356c req-5bdb87d0-cd2b-403c-8b77-99e0c9e8cd49 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.1700635 Dec 08 11:36:49.862763 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-706508cf-9ace-4994-be76-9801423d804e req-c12a4617-5e12-4ab1-896f-fc285f9cbac3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:49.864248 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-706508cf-9ace-4994-be76-9801423d804e req-c12a4617-5e12-4ab1-896f-fc285f9cbac3 tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 946 time: 0.1667869 Dec 08 11:36:49.962482 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8361c806-0e26-4743-8d44-fe7f9a6ceed2 req-85e7d12c-2ede-46ea-b034-441632bff05b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:49.963764 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8361c806-0e26-4743-8d44-fe7f9a6ceed2 req-85e7d12c-2ede-46ea-b034-441632bff05b tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 946 time: 0.1768711 Dec 08 11:36:50.052846 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-07046a9a-f124-440d-9ad2-f6fb666f356c req-7eef457f-2151-4088-876a-c44b68691384 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2204201 Dec 08 11:36:50.096369 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8074906', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7896871'] for router_interface, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:50.107193 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8361c806-0e26-4743-8d44-fe7f9a6ceed2 req-8decd932-16df-45b1-830a-7a142bf1e65d tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/security-groups?id=bd345d28-0a71-431c-a740-203ea22e74a5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1322610 Dec 08 11:36:50.165727 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-706508cf-9ace-4994-be76-9801423d804e req-b01d5d12-b53b-4b17-b920-24a58fe2d82e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Deleting port d9ecab87-157e-4ccb-8423-2248bb8451ea {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:36:50.165966 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-706508cf-9ace-4994-be76-9801423d804e req-b01d5d12-b53b-4b17-b920-24a58fe2d82e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:50.303364 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-706508cf-9ace-4994-be76-9801423d804e req-b01d5d12-b53b-4b17-b920-24a58fe2d82e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] For port d9ecab87-157e-4ccb-8423-2248bb8451ea, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d9ecab87-157e-4ccb-8423-2248bb8451ea,segment=NetworkSegment(6591c62b-7ba0-41ad-8d14-59c272604f28),segment_id=6591c62b-7ba0-41ad-8d14-59c272604f28)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:36:50.303733 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-706508cf-9ace-4994-be76-9801423d804e req-b01d5d12-b53b-4b17-b920-24a58fe2d82e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:50.350992 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-706508cf-9ace-4994-be76-9801423d804e req-b01d5d12-b53b-4b17-b920-24a58fe2d82e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Calling delete_port for d9ecab87-157e-4ccb-8423-2248bb8451ea owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:36:50.490589 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Router 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:36:50.527484 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-476a36d7-44c6-4956-9df0-de2ffcc268a3 req-0766bcb8-eaca-42c6-bd13-56d76a142143 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:50.528966 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-476a36d7-44c6-4956-9df0-de2ffcc268a3 req-0766bcb8-eaca-42c6-bd13-56d76a142143 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0898142 Dec 08 11:36:50.677910 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-706508cf-9ace-4994-be76-9801423d804e req-b01d5d12-b53b-4b17-b920-24a58fe2d82e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:50.727416 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b01d5d12-b53b-4b17-b920-24a58fe2d82e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Pushing event deleted for resources: {'Port': ['ID=d9ecab87-157e-4ccb-8423-2248bb8451ea,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:50.736658 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-476a36d7-44c6-4956-9df0-de2ffcc268a3 req-097a41b0-c9fe-4c20-8259-cf781b87e11b tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1578581 Dec 08 11:36:50.744211 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:36:50.753430 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc194ee8-b755-4923-ba3a-619d4847e066 None None] Sync routers for ids ['0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:36:50.764587 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc194ee8-b755-4923-ba3a-619d4847e066 None None] Routers {'0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:36:50.765220 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-cc194ee8-b755-4923-ba3a-619d4847e066 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:36:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:50.768837 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-306afd88-5682-4df9-8277-ffc522c494b3 admin admin] 10.222.0.66 "PUT /v2.0/routers/0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5898459 Dec 08 11:36:50.769635 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55472) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:50.785755 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-706508cf-9ace-4994-be76-9801423d804e req-b01d5d12-b53b-4b17-b920-24a58fe2d82e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] No DVR routers for this DVR port d9ecab87-157e-4ccb-8423-2248bb8451ea on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:36:50.788192 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-706508cf-9ace-4994-be76-9801423d804e req-b01d5d12-b53b-4b17-b920-24a58fe2d82e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:50.791629 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-706508cf-9ace-4994-be76-9801423d804e req-b01d5d12-b53b-4b17-b920-24a58fe2d82e tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.61 "DELETE /v2.0/ports/d9ecab87-157e-4ccb-8423-2248bb8451ea HTTP/1.1" status: 204 len: 173 time: 0.8931794 Dec 08 11:36:50.792075 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c7fa09fb-ae2b-4479-8848-f142131fe33a', 'name': 'network-vif-deleted', 'tag': 'd9ecab87-157e-4ccb-8423-2248bb8451ea'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:36:50.794334 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dc0b51bf-05e6-4d91-b8d5-ccaaa405998f" -d '{"events": [{"server_uuid": "c7fa09fb-ae2b-4479-8848-f142131fe33a", "name": "network-vif-deleted", "tag": "d9ecab87-157e-4ccb-8423-2248bb8451ea"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:36:50.846855 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:36:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7fbc97de-7c9c-49f1-92cc-1ad90e75ee65 x-openstack-request-id: req-7fbc97de-7c9c-49f1-92cc-1ad90e75ee65 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:36:50.847157 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c7fa09fb-ae2b-4479-8848-f142131fe33a", "name": "network-vif-deleted", "tag": "d9ecab87-157e-4ccb-8423-2248bb8451ea", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:36:50.847419 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-7fbc97de-7c9c-49f1-92cc-1ad90e75ee65 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:36:50.847820 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c7fa09fb-ae2b-4479-8848-f142131fe33a', 'name': 'network-vif-deleted', 'tag': 'd9ecab87-157e-4ccb-8423-2248bb8451ea', 'status': 'completed', 'code': 200} Dec 08 11:36:50.914870 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Publish callbacks [] for router, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:50.968265 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-cc194ee8-b755-4923-ba3a-619d4847e066 None None] Set router 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:36:51.024951 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.094487 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Deleting port 778abdc6-77b1-45e0-88ad-ee39bfea6d21 {{(pid=102317) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:36:51.095085 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.159480 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-cc194ee8-b755-4923-ba3a-619d4847e066 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'name': 'tempest-ServerRescueNegativeTestJSON-1990879057-router', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72'}], 'enable_snat': True}, 'gw_port_id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:31Z', 'updated_at': '2021-12-08T11:36:49Z', 'revision_number': 5, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'gw_port': {'id': '778abdc6-77b1-45e0-88ad-ee39bfea6d21', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:3d:e4:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.72', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:32Z', 'updated_at': '2021-12-08T11:32:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:51.183527 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] For port 778abdc6-77b1-45e0-88ad-ee39bfea6d21, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=778abdc6-77b1-45e0-88ad-ee39bfea6d21,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102317) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:36:51.183905 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.198698 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Calling delete_port for 778abdc6-77b1-45e0-88ad-ee39bfea6d21 owned by network:router_gateway {{(pid=102317) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:36:51.206625 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc194ee8-b755-4923-ba3a-619d4847e066 None None] Checking router: 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:36:51.221024 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc194ee8-b755-4923-ba3a-619d4847e066 None None] Routers {'0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:36:51.224099 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-cc194ee8-b755-4923-ba3a-619d4847e066 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:36:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:51.270313 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-30e4a897-100e-44dd-b4b4-835070cfab61 req-7057b307-5025-4e49-b44a-418d1e6c88be tempest-AttachVolumeNegativeTest-15824628 tempest-AttachVolumeNegativeTest-15824628-project] 10.222.0.66 "GET /v2.0/ports?device_id=c7fa09fb-ae2b-4479-8848-f142131fe33a HTTP/1.1" status: 200 len: 210 time: 0.0601239 Dec 08 11:36:51.333684 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-cc194ee8-b755-4923-ba3a-619d4847e066 None None] Set router 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c gateway port host: None {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:36:51.391629 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-cc194ee8-b755-4923-ba3a-619d4847e066 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'name': 'tempest-ServerRescueNegativeTestJSON-1990879057-router', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:31Z', 'updated_at': '2021-12-08T11:36:51Z', 'revision_number': 6, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'gw_port_host': None}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:51.420362 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc194ee8-b755-4923-ba3a-619d4847e066 None None] The sync data for ids ['0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c'] in dv-cinder-819778-3-iscsi is: [{'id': '0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c', 'name': 'tempest-ServerRescueNegativeTestJSON-1990879057-router', 'tenant_id': '801ccccb4d7647de8e9558e07ebdc070', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:31Z', 'updated_at': '2021-12-08T11:36:51Z', 'revision_number': 6, 'project_id': '801ccccb4d7647de8e9558e07ebdc070', 'gw_port_host': None}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:36:51.432677 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.470762 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Pushing event deleted for resources: {'Port': ['ID=778abdc6-77b1-45e0-88ad-ee39bfea6d21,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:51.492661 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:51.493032 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:51.493468 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:51.493870 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:51.494225 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:51.494547 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:51.494872 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:51.495249 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:51.495609 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:51.496644 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:51.496965 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:51.497314 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:51.497630 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:36:51.541217 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7889737'] for router_gateway, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.643637 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7895253', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32185'] for router, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.645709 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.708326 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7895086'] for router, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.708784 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c {{(pid=102317) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 08 11:36:51.713649 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] Publish callbacks [] for router, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.714810 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-e469096c-2aa7-49a0-a8cf-beb7f8fcb800 admin admin] 10.222.0.66 "DELETE /v2.0/routers/0b46f7b3-1e8d-4fcd-8e81-00b0bc9e614c HTTP/1.1" status: 204 len: 168 time: 0.9440463 Dec 08 11:36:51.717318 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55490) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:51.765589 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_v2 [None req-dff7fb08-df01-4ceb-bdb2-f0c714a667b6 admin admin] Deleting subnet 59ab11c2-3db5-4069-afa6-b6f825d69316 {{(pid=102317) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:36:51.768880 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dff7fb08-df01-4ceb-bdb2-f0c714a667b6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.806401 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dff7fb08-df01-4ceb-bdb2-f0c714a667b6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4850389'] for subnet, precommit_delete_associations {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.857315 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dff7fb08-df01-4ceb-bdb2-f0c714a667b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.863408 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b12a2acd-b29d-4c2d-a691-2b5509a5fcfb req-c451a47f-359d-40a3-84c2-fd58ff31d497 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:51.864961 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b12a2acd-b29d-4c2d-a691-2b5509a5fcfb req-c451a47f-359d-40a3-84c2-fd58ff31d497 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0505905 Dec 08 11:36:51.916294 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dff7fb08-df01-4ceb-bdb2-f0c714a667b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5645791', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5419674'] for subnet, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.927472 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b12a2acd-b29d-4c2d-a691-2b5509a5fcfb req-d2589988-372c-4a0d-bedf-4c44b2f22cd5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0559154 Dec 08 11:36:51.948520 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dff7fb08-df01-4ceb-bdb2-f0c714a667b6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=59ab11c2-3db5-4069-afa6-b6f825d69316,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:51.953915 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-dff7fb08-df01-4ceb-bdb2-f0c714a667b6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:51.960238 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55494) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:51.960372 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-dff7fb08-df01-4ceb-bdb2-f0c714a667b6 admin admin] 10.222.0.66 "DELETE /v2.0/subnets/59ab11c2-3db5-4069-afa6-b6f825d69316 HTTP/1.1" status: 204 len: 168 time: 0.2420051 Dec 08 11:36:52.032042 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9dd3ddfd-00cf-48ff-942a-1960a55d465c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.078645 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device d9ecab87-157e-4ccb-8423-2248bb8451ea no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:36:52.101237 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: d9ecab87-157e-4ccb-8423-2248bb8451ea {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:36:52.101589 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device d9ecab87-157e-4ccb-8423-2248bb8451ea not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:36:52.118785 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9dd3ddfd-00cf-48ff-942a-1960a55d465c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.138647 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-9dd3ddfd-00cf-48ff-942a-1960a55d465c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b799b290-99c1-4693-82cc-42bbd4d90adb']}} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:52.148486 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-9dd3ddfd-00cf-48ff-942a-1960a55d465c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'aa890c2f-8ce4-49b3-a366-4788a314e043') {'for_net_delete': True} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:52.148780 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-9dd3ddfd-00cf-48ff-942a-1960a55d465c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'aa890c2f-8ce4-49b3-a366-4788a314e043') {} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:52.159248 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9dd3ddfd-00cf-48ff-942a-1960a55d465c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16370039'] for segment, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.172909 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9dd3ddfd-00cf-48ff-942a-1960a55d465c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.179192 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9dd3ddfd-00cf-48ff-942a-1960a55d465c admin admin] Releasing vlan 252 on physical network physnet1 to pool {{(pid=102318) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:36:52.179600 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9dd3ddfd-00cf-48ff-942a-1960a55d465c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4575654'] for segment, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: Traceback (most recent call last): Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: timer() Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: cb(*args, **kw) Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: return func(*args, **kwargs) Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: self._notify() Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: self.callback(batched_events) Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: event.method(event) Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: return f(self, *a, **k) Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._get(url).json() Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: return self.request(url, 'GET', **kwargs) Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:36:52.181275 dv-cinder-819778-3-iscsi neutron-server[102318]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:36:52.247578 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9dd3ddfd-00cf-48ff-942a-1960a55d465c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.255445 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9dd3ddfd-00cf-48ff-942a-1960a55d465c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.258733 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-9dd3ddfd-00cf-48ff-942a-1960a55d465c admin admin] 10.222.0.66 "DELETE /v2.0/networks/b799b290-99c1-4693-82cc-42bbd4d90adb HTTP/1.1" status: 204 len: 168 time: 0.2972510 Dec 08 11:36:52.269311 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dd3ddfd-00cf-48ff-942a-1960a55d465c admin admin] Pushing event deleted for resources: {'Network': ['ID=b799b290-99c1-4693-82cc-42bbd4d90adb,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:52.352355 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55502) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:52.415737 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 56107fd6-be43-48a1-b2a0-e0180cab581a no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:36:52.439529 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 56107fd6-be43-48a1-b2a0-e0180cab581a {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:36:52.440062 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 56107fd6-be43-48a1-b2a0-e0180cab581a not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:36:52.440495 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 778abdc6-77b1-45e0-88ad-ee39bfea6d21 no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:36:52.467565 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 778abdc6-77b1-45e0-88ad-ee39bfea6d21 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:36:52.467910 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 778abdc6-77b1-45e0-88ad-ee39bfea6d21 not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:36:52.482905 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-ae991941-85c8-4364-9b7a-a886dfa9850e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.532287 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_v2 [None req-d7c24b60-1bc8-417a-829a-bbccc1f63705 admin admin] Deleting subnet d6b1fb0e-d38f-47ca-a647-53b824c47e76 {{(pid=102318) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:36:52.535739 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d7c24b60-1bc8-417a-829a-bbccc1f63705 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.551481 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55506) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:52.571581 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d7c24b60-1bc8-417a-829a-bbccc1f63705 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16370044'] for subnet, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.596777 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-3248e896-ccb7-4768-a786-f472d59cf5bf admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=801ccccb4d7647de8e9558e07ebdc070&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0440090 Dec 08 11:36:52.599344 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55508) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:52.627063 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d7c24b60-1bc8-417a-829a-bbccc1f63705 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.649434 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-66f4f8a7-3cca-41e8-b3cf-28fa4c2cb521 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.669824 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-66f4f8a7-3cca-41e8-b3cf-28fa4c2cb521 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.680247 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d7c24b60-1bc8-417a-829a-bbccc1f63705 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4572160', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-16496636'] for subnet, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.711828 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7c24b60-1bc8-417a-829a-bbccc1f63705 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d6b1fb0e-d38f-47ca-a647-53b824c47e76,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:52.713823 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d7c24b60-1bc8-417a-829a-bbccc1f63705 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.717250 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-d7c24b60-1bc8-417a-829a-bbccc1f63705 admin admin] 10.222.0.66 "DELETE /v2.0/subnets/d6b1fb0e-d38f-47ca-a647-53b824c47e76 HTTP/1.1" status: 204 len: 168 time: 0.3637888 Dec 08 11:36:52.720129 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55510) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:52.727968 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-66f4f8a7-3cca-41e8-b3cf-28fa4c2cb521 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.730557 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-66f4f8a7-3cca-41e8-b3cf-28fa4c2cb521 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.731601 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-66f4f8a7-3cca-41e8-b3cf-28fa4c2cb521 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/75bd5163-3e52-4a6c-84d2-db036e5fa483 HTTP/1.1" status: 204 len: 168 time: 0.1311722 Dec 08 11:36:52.776631 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66f4f8a7-3cca-41e8-b3cf-28fa4c2cb521 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75bd5163-3e52-4a6c-84d2-db036e5fa483,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:52.804910 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-10711503-06e6-474a-9d6e-637934538283 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.883853 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-10711503-06e6-474a-9d6e-637934538283 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.904720 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-10711503-06e6-474a-9d6e-637934538283 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6e4bda07-1ae1-4be4-bf28-e94211f51919']}} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:52.915045 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-10711503-06e6-474a-9d6e-637934538283 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6591c62b-7ba0-41ad-8d14-59c272604f28') {'for_net_delete': True} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:52.915344 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-10711503-06e6-474a-9d6e-637934538283 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6591c62b-7ba0-41ad-8d14-59c272604f28') {} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:52.927337 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-10711503-06e6-474a-9d6e-637934538283 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4850398'] for segment, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.944225 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-10711503-06e6-474a-9d6e-637934538283 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.951955 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-10711503-06e6-474a-9d6e-637934538283 admin admin] Releasing vlan 277 on physical network physnet1 to pool {{(pid=102317) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:36:52.952582 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-10711503-06e6-474a-9d6e-637934538283 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5648505'] for segment, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: Traceback (most recent call last): Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: timer() Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: cb(*args, **kw) Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: return func(*args, **kwargs) Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: self._notify() Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: self.callback(batched_events) Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: event.method(event) Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: return f(self, *a, **k) Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._get(url).json() Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: return self.request(url, 'GET', **kwargs) Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:36:52.954480 dv-cinder-819778-3-iscsi neutron-server[102317]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:36:53.014760 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-10711503-06e6-474a-9d6e-637934538283 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:53.020638 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-10711503-06e6-474a-9d6e-637934538283 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:53.025811 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-10711503-06e6-474a-9d6e-637934538283 admin admin] 10.222.0.66 "DELETE /v2.0/networks/6e4bda07-1ae1-4be4-bf28-e94211f51919 HTTP/1.1" status: 204 len: 168 time: 0.3046067 Dec 08 11:36:53.038065 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10711503-06e6-474a-9d6e-637934538283 admin admin] Pushing event deleted for resources: {'Network': ['ID=6e4bda07-1ae1-4be4-bf28-e94211f51919,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:53.061004 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ce7c2b5-593c-41b5-aa65-8cc1583e4c64 req-9e4003ee-a835-44b2-80e1-7211a537da14 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:53.062636 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5ce7c2b5-593c-41b5-aa65-8cc1583e4c64 req-9e4003ee-a835-44b2-80e1-7211a537da14 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0647438 Dec 08 11:36:53.139312 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5ce7c2b5-593c-41b5-aa65-8cc1583e4c64 req-68ebafbd-d68e-494b-a610-aa4e420a76d7 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&id=7c872497-d719-4618-a000-bf3059a98a01&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0684228 Dec 08 11:36:53.165749 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55528) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:53.208063 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-11cb1286-ec79-47cb-b474-7c98b90028c4 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=34e91fcdeaf64d10965b2770cbeab690&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0409224 Dec 08 11:36:53.209747 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55532) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:53.261556 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-69f99fc8-69da-48f7-b4aa-f7f382901c86 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:53.283367 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-69f99fc8-69da-48f7-b4aa-f7f382901c86 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:53.330847 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-69f99fc8-69da-48f7-b4aa-f7f382901c86 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:53.333559 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-69f99fc8-69da-48f7-b4aa-f7f382901c86 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:53.335439 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-69f99fc8-69da-48f7-b4aa-f7f382901c86 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/bd345d28-0a71-431c-a740-203ea22e74a5 HTTP/1.1" status: 204 len: 168 time: 0.1246471 Dec 08 11:36:53.344090 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69f99fc8-69da-48f7-b4aa-f7f382901c86 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd345d28-0a71-431c-a740-203ea22e74a5,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:53.641556 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b853e13a-fced-47e6-92be-14f933a69b7b req-0869728e-81ef-485f-b723-fa65edb0afde tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:53.643688 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b853e13a-fced-47e6-92be-14f933a69b7b req-0869728e-81ef-485f-b723-fa65edb0afde tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0560334 Dec 08 11:36:53.691766 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b853e13a-fced-47e6-92be-14f933a69b7b req-4e7eb0ce-bec4-48b2-a6d0-853d48488190 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412896 Dec 08 11:36:54.076769 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55582) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:54.174812 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1509199389-network', 'tenant_id': '7b1bd1e2659e475d82b501255ce5c6de'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:36:54.195466 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Made reservation on behalf of 7b1bd1e2659e475d82b501255ce5c6de for: {'network': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:36:54.198901 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:54.206499 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:54.290418 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:54.296000 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:54.317456 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] vlan segment allocate from pool success with {'vlan_id': 290, 'physical_network': 'physnet1'} {{(pid=102318) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:36:54.333061 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74ef08f2-674c-477e-a660-9ffd3a33724c,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:54.335966 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:54.336317 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.segments_db [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Added segment f1cf4408-b3eb-497a-9779-40a4aace0104 of type vlan for network 93650a0d-dde0-432d-9552-6aac6fba7b52 Dec 08 11:36:54.376416 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:54.401547 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:54.402533 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:54.403785 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:54.455546 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.3743899 Dec 08 11:36:54.456380 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55600) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:54.462496 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-f91a4472-db71-467c-a69b-944c73b2df78 admin admin] Request body: {'subnet': {'network_id': '93650a0d-dde0-432d-9552-6aac6fba7b52', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1509199389-subnet', 'tenant_id': '7b1bd1e2659e475d82b501255ce5c6de', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:36:54.467116 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeed526a-9daa-4ced-baea-4c434388ea3d admin admin] Pushing event updated for resources: {'Network': ['ID=93650a0d-dde0-432d-9552-6aac6fba7b52,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:54.478149 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network 93650a0d-dde0-432d-9552-6aac6fba7b52 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:36:54.487674 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f91a4472-db71-467c-a69b-944c73b2df78 admin admin] Made reservation on behalf of 7b1bd1e2659e475d82b501255ce5c6de for: {'subnet': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:36:54.490099 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f91a4472-db71-467c-a69b-944c73b2df78 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5419653'] for subnet, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:54.666397 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f91a4472-db71-467c-a69b-944c73b2df78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5645724', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5419667'] for subnet, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:54.698342 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2eb8c268-07d4-450e-82a7-ee733cd3482c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:54.730656 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f91a4472-db71-467c-a69b-944c73b2df78 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d0f173c8-f79f-4bb7-8b1f-f22c0930d118,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:54.744670 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f91a4472-db71-467c-a69b-944c73b2df78 admin admin] Checking segment: {'id': 'f1cf4408-b3eb-497a-9779-40a4aace0104', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 290, 'network_id': '93650a0d-dde0-432d-9552-6aac6fba7b52'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:36:54.745057 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f91a4472-db71-467c-a69b-944c73b2df78 admin admin] Network hostable DHCP agents. Network: 93650a0d-dde0-432d-9552-6aac6fba7b52, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102317) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:36:54.763181 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f91a4472-db71-467c-a69b-944c73b2df78 admin admin] Network 93650a0d-dde0-432d-9552-6aac6fba7b52 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102317) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:36:54.774486 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-f91a4472-db71-467c-a69b-944c73b2df78 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, 93650a0d-dde0-432d-9552-6aac6fba7b52) {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:36:54.779767 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f91a4472-db71-467c-a69b-944c73b2df78 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:54.780371 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f91a4472-db71-467c-a69b-944c73b2df78 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:54.784732 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63f5f094-6cb7-477b-ad58-133ce3225ffa None None] Network 93650a0d-dde0-432d-9552-6aac6fba7b52 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:36:54.807919 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-f91a4472-db71-467c-a69b-944c73b2df78 admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.3493958 Dec 08 11:36:54.828579 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64f771a4-7750-4307-9c94-8ccf7478dddd req-1484225a-6410-452e-ab06-297567565fd5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:54.830289 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-64f771a4-7750-4307-9c94-8ccf7478dddd req-1484225a-6410-452e-ab06-297567565fd5 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0612833 Dec 08 11:36:54.883251 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-64f771a4-7750-4307-9c94-8ccf7478dddd req-7a80f4b6-bb3c-44ba-a29b-80a08e488ab4 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464041 Dec 08 11:36:54.888597 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c48d751-760b-428e-8a3e-1d9ade399888 None None] Network 93650a0d-dde0-432d-9552-6aac6fba7b52 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:36:55.265605 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55622) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:55.270735 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1702258791-network', 'tenant_id': 'f6029d81aac141ea8f8c02f2b4f8f6cb'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:36:55.290309 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Made reservation on behalf of f6029d81aac141ea8f8c02f2b4f8f6cb for: {'network': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:36:55.292537 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:55.301067 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:55.372356 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:55.375877 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:55.396540 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] vlan segment allocate from pool success with {'vlan_id': 272, 'physical_network': 'physnet1'} {{(pid=102318) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:36:55.410292 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c041977-968d-4095-b0b6-f19afd4005c8,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:55.414949 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:55.415293 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.segments_db [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Added segment 365c169f-ae98-4fb2-9e2b-ad357cbe2189 of type vlan for network c3edf7a2-896a-4eee-b48a-37074c863da9 Dec 08 11:36:55.454648 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:55.479794 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:55.480659 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:55.481288 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:55.538212 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.2711842 Dec 08 11:36:55.541070 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55624) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:55.545333 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3bbe928-3ae0-4985-ba14-d0f7c69f159c admin admin] Pushing event updated for resources: {'Network': ['ID=c3edf7a2-896a-4eee-b48a-37074c863da9,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:55.546103 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-bae19e0a-2c83-486c-8efd-ab8b7c086103 admin admin] Request body: {'subnet': {'network_id': 'c3edf7a2-896a-4eee-b48a-37074c863da9', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1702258791-subnet', 'tenant_id': 'f6029d81aac141ea8f8c02f2b4f8f6cb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:36:55.555166 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network c3edf7a2-896a-4eee-b48a-37074c863da9 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:36:55.570106 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bae19e0a-2c83-486c-8efd-ab8b7c086103 admin admin] Made reservation on behalf of f6029d81aac141ea8f8c02f2b4f8f6cb for: {'subnet': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:36:55.572452 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bae19e0a-2c83-486c-8efd-ab8b7c086103 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5419653'] for subnet, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:55.740687 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bae19e0a-2c83-486c-8efd-ab8b7c086103 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5645724', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5419667'] for subnet, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:55.781728 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:55.794497 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bae19e0a-2c83-486c-8efd-ab8b7c086103 admin admin] Pushing event updated for resources: {'Subnet': ['ID=72bda9c4-3ff0-4c29-9b89-e8161b9ec526,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:55.809403 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bae19e0a-2c83-486c-8efd-ab8b7c086103 admin admin] Checking segment: {'id': '365c169f-ae98-4fb2-9e2b-ad357cbe2189', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 272, 'network_id': 'c3edf7a2-896a-4eee-b48a-37074c863da9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:36:55.809831 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bae19e0a-2c83-486c-8efd-ab8b7c086103 admin admin] Network hostable DHCP agents. Network: c3edf7a2-896a-4eee-b48a-37074c863da9, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102317) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:36:55.830901 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bae19e0a-2c83-486c-8efd-ab8b7c086103 admin admin] Network c3edf7a2-896a-4eee-b48a-37074c863da9 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102317) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:36:55.846510 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-bae19e0a-2c83-486c-8efd-ab8b7c086103 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, c3edf7a2-896a-4eee-b48a-37074c863da9) {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:36:55.851458 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bae19e0a-2c83-486c-8efd-ab8b7c086103 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:55.852083 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bae19e0a-2c83-486c-8efd-ab8b7c086103 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:55.857191 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-19a3338b-f1ac-4b81-bfe6-f70d3657f54e None None] Network c3edf7a2-896a-4eee-b48a-37074c863da9 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:36:55.871555 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-bae19e0a-2c83-486c-8efd-ab8b7c086103 admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.3293059 Dec 08 11:36:55.879958 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 req-7a68adc0-99b1-4029-8a70-19bc36c7e521 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:55.881897 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 req-7a68adc0-99b1-4029-8a70-19bc36c7e521 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.61 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0665655 Dec 08 11:36:55.993068 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-da9abf09-3252-4a23-b36c-e613c759be99 None None] Network c3edf7a2-896a-4eee-b48a-37074c863da9 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:36:56.015660 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55644) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:56.064253 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_v2 [None req-e7df6c21-748e-4bde-897b-3b6bcf2e8760 admin admin] Deleting subnet d0f173c8-f79f-4bb7-8b1f-f22c0930d118 {{(pid=102317) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:36:56.068736 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e7df6c21-748e-4bde-897b-3b6bcf2e8760 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.076821 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26249ade-959f-488c-b0f1-9d306fded333 req-783fe0ff-3bdb-4bb0-9470-95e84d7e6f6e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:36:56.078454 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-26249ade-959f-488c-b0f1-9d306fded333 req-783fe0ff-3bdb-4bb0-9470-95e84d7e6f6e tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/ports?device_id=87e72067-7d43-45ee-9f67-e4a72419ea29 HTTP/1.1" status: 200 len: 946 time: 0.0743508 Dec 08 11:36:56.081729 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 req-3829c55e-02ba-4ae5-b69e-2a2638a1ad6f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Deleting port a6ac8770-1fec-45c1-8b57-a96317ee73ed {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:36:56.082114 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 req-3829c55e-02ba-4ae5-b69e-2a2638a1ad6f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.107075 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e7df6c21-748e-4bde-897b-3b6bcf2e8760 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4850389'] for subnet, precommit_delete_associations {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.146949 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e7df6c21-748e-4bde-897b-3b6bcf2e8760 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.205565 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e7df6c21-748e-4bde-897b-3b6bcf2e8760 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5645791', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5419674'] for subnet, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.209796 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-26249ade-959f-488c-b0f1-9d306fded333 req-ccc877fb-023f-49b0-a65d-6bec5a20d1f3 tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.66 "GET /v2.0/security-groups?id=17fd259e-0c88-4f2b-9716-9b0c3abb9504&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0846496 Dec 08 11:36:56.222022 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 req-3829c55e-02ba-4ae5-b69e-2a2638a1ad6f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] For port a6ac8770-1fec-45c1-8b57-a96317ee73ed, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=a6ac8770-1fec-45c1-8b57-a96317ee73ed,segment=NetworkSegment(93ea5ca7-22ef-4002-8579-aa09922044a7),segment_id=93ea5ca7-22ef-4002-8579-aa09922044a7)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:36:56.231753 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 req-3829c55e-02ba-4ae5-b69e-2a2638a1ad6f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.232088 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7df6c21-748e-4bde-897b-3b6bcf2e8760 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d0f173c8-f79f-4bb7-8b1f-f22c0930d118,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:56.235276 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 req-3829c55e-02ba-4ae5-b69e-2a2638a1ad6f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Calling delete_port for a6ac8770-1fec-45c1-8b57-a96317ee73ed owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:36:56.238659 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e7df6c21-748e-4bde-897b-3b6bcf2e8760 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.241912 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-e7df6c21-748e-4bde-897b-3b6bcf2e8760 admin admin] 10.222.0.66 "DELETE /v2.0/subnets/d0f173c8-f79f-4bb7-8b1f-f22c0930d118 HTTP/1.1" status: 204 len: 168 time: 0.2256956 Dec 08 11:36:56.244441 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55646) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:56.311111 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e6660188-edc5-4482-ac26-b49b82e03ada admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.361211 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 req-3829c55e-02ba-4ae5-b69e-2a2638a1ad6f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.376774 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['a6ac8770-1fec-45c1-8b57-a96317ee73ed'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:36:56.393918 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3829c55e-02ba-4ae5-b69e-2a2638a1ad6f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Pushing event deleted for resources: {'Port': ['ID=a6ac8770-1fec-45c1-8b57-a96317ee73ed,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:56.394805 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e6660188-edc5-4482-ac26-b49b82e03ada admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.419308 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-e6660188-edc5-4482-ac26-b49b82e03ada admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['93650a0d-dde0-432d-9552-6aac6fba7b52']}} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:56.429533 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-e6660188-edc5-4482-ac26-b49b82e03ada admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f1cf4408-b3eb-497a-9779-40a4aace0104') {'for_net_delete': True} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:56.429828 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-e6660188-edc5-4482-ac26-b49b82e03ada admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f1cf4408-b3eb-497a-9779-40a4aace0104') {} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:56.433727 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 req-3829c55e-02ba-4ae5-b69e-2a2638a1ad6f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] No DVR routers for this DVR port a6ac8770-1fec-45c1-8b57-a96317ee73ed on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:36:56.436145 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 req-3829c55e-02ba-4ae5-b69e-2a2638a1ad6f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.439935 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e6660188-edc5-4482-ac26-b49b82e03ada admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4850398'] for segment, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.440107 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9d09f20b-a6e2-4ad9-bf19-d0e3f2676347 req-3829c55e-02ba-4ae5-b69e-2a2638a1ad6f tempest-VolumesSnapshotTestJSON-2053264051 tempest-VolumesSnapshotTestJSON-2053264051-project] 10.222.0.61 "DELETE /v2.0/ports/a6ac8770-1fec-45c1-8b57-a96317ee73ed HTTP/1.1" status: 204 len: 173 time: 0.5515614 Dec 08 11:36:56.440531 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '87e72067-7d43-45ee-9f67-e4a72419ea29', 'name': 'network-vif-deleted', 'tag': 'a6ac8770-1fec-45c1-8b57-a96317ee73ed'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:36:56.442851 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-663a0527-0c07-4a2f-95e4-24c11d951951" -d '{"events": [{"server_uuid": "87e72067-7d43-45ee-9f67-e4a72419ea29", "name": "network-vif-deleted", "tag": "a6ac8770-1fec-45c1-8b57-a96317ee73ed"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:36:56.454849 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e6660188-edc5-4482-ac26-b49b82e03ada admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.461773 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e6660188-edc5-4482-ac26-b49b82e03ada admin admin] Releasing vlan 290 on physical network physnet1 to pool {{(pid=102317) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:36:56.462243 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e6660188-edc5-4482-ac26-b49b82e03ada admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5648505'] for segment, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: Traceback (most recent call last): Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: timer() Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: cb(*args, **kw) Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: return func(*args, **kwargs) Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: self._notify() Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: self.callback(batched_events) Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: event.method(event) Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: return f(self, *a, **k) Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._get(url).json() Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: return self.request(url, 'GET', **kwargs) Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:36:56.463806 dv-cinder-819778-3-iscsi neutron-server[102317]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:36:56.480297 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:36:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-53a6bf34-d150-4040-9efa-1a2d55e0d028 x-openstack-request-id: req-53a6bf34-d150-4040-9efa-1a2d55e0d028 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:36:56.480595 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "87e72067-7d43-45ee-9f67-e4a72419ea29", "name": "network-vif-deleted", "tag": "a6ac8770-1fec-45c1-8b57-a96317ee73ed", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:36:56.480878 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-53a6bf34-d150-4040-9efa-1a2d55e0d028 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:36:56.481321 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '87e72067-7d43-45ee-9f67-e4a72419ea29', 'name': 'network-vif-deleted', 'tag': 'a6ac8770-1fec-45c1-8b57-a96317ee73ed', 'status': 'completed', 'code': 200} Dec 08 11:36:56.519284 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e6660188-edc5-4482-ac26-b49b82e03ada admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.525955 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e6660188-edc5-4482-ac26-b49b82e03ada admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.529357 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-e6660188-edc5-4482-ac26-b49b82e03ada admin admin] 10.222.0.66 "DELETE /v2.0/networks/93650a0d-dde0-432d-9552-6aac6fba7b52 HTTP/1.1" status: 204 len: 168 time: 0.2838404 Dec 08 11:36:56.533711 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55650) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:56.540999 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6660188-edc5-4482-ac26-b49b82e03ada admin admin] Pushing event deleted for resources: {'Network': ['ID=93650a0d-dde0-432d-9552-6aac6fba7b52,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:56.577009 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_v2 [None req-02ae6c9e-e7d3-4af7-90d8-99aede2962dd admin admin] Deleting subnet 72bda9c4-3ff0-4c29-9b89-e8161b9ec526 {{(pid=102318) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:36:56.580339 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-02ae6c9e-e7d3-4af7-90d8-99aede2962dd admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.616824 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-02ae6c9e-e7d3-4af7-90d8-99aede2962dd admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16370044'] for subnet, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.656366 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-02ae6c9e-e7d3-4af7-90d8-99aede2962dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.705552 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-02ae6c9e-e7d3-4af7-90d8-99aede2962dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4572160', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-16496636'] for subnet, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.731325 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02ae6c9e-e7d3-4af7-90d8-99aede2962dd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=72bda9c4-3ff0-4c29-9b89-e8161b9ec526,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:56.733398 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-02ae6c9e-e7d3-4af7-90d8-99aede2962dd admin admin] Publish callbacks [] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.737070 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-02ae6c9e-e7d3-4af7-90d8-99aede2962dd admin admin] 10.222.0.66 "DELETE /v2.0/subnets/72bda9c4-3ff0-4c29-9b89-e8161b9ec526 HTTP/1.1" status: 204 len: 168 time: 0.2033837 Dec 08 11:36:56.739590 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55652) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:56.804440 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f8de919d-8190-4c2c-a03a-728cd0ec7ddb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.884156 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f8de919d-8190-4c2c-a03a-728cd0ec7ddb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.910610 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-f8de919d-8190-4c2c-a03a-728cd0ec7ddb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c3edf7a2-896a-4eee-b48a-37074c863da9']}} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:56.919803 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-f8de919d-8190-4c2c-a03a-728cd0ec7ddb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '365c169f-ae98-4fb2-9e2b-ad357cbe2189') {'for_net_delete': True} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:56.920099 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-f8de919d-8190-4c2c-a03a-728cd0ec7ddb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '365c169f-ae98-4fb2-9e2b-ad357cbe2189') {} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:36:56.930325 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f8de919d-8190-4c2c-a03a-728cd0ec7ddb admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16370039'] for segment, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.944956 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f8de919d-8190-4c2c-a03a-728cd0ec7ddb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.951735 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f8de919d-8190-4c2c-a03a-728cd0ec7ddb admin admin] Releasing vlan 272 on physical network physnet1 to pool {{(pid=102318) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:36:56.952111 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f8de919d-8190-4c2c-a03a-728cd0ec7ddb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4575654'] for segment, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: Traceback (most recent call last): Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: timer() Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: cb(*args, **kw) Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: return func(*args, **kwargs) Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: self._notify() Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: self.callback(batched_events) Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: event.method(event) Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: return f(self, *a, **k) Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._get(url).json() Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: return self.request(url, 'GET', **kwargs) Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:36:56.953887 dv-cinder-819778-3-iscsi neutron-server[102318]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:36:57.139884 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.264396 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f8de919d-8190-4c2c-a03a-728cd0ec7ddb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.269650 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55662) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:57.278605 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f8de919d-8190-4c2c-a03a-728cd0ec7ddb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.282010 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-f8de919d-8190-4c2c-a03a-728cd0ec7ddb admin admin] 10.222.0.66 "DELETE /v2.0/networks/c3edf7a2-896a-4eee-b48a-37074c863da9 HTTP/1.1" status: 204 len: 168 time: 0.5415075 Dec 08 11:36:57.298943 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8de919d-8190-4c2c-a03a-728cd0ec7ddb admin admin] Pushing event deleted for resources: {'Network': ['ID=c3edf7a2-896a-4eee-b48a-37074c863da9,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:57.394804 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-096bf7ad-5a2a-4462-9006-e830f93a4905 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.403786 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55670) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:57.449996 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-f8db031c-4356-452b-a469-f7deca0a25fb admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=7b1bd1e2659e475d82b501255ce5c6de&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0450490 Dec 08 11:36:57.452525 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55672) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:57.475191 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-096bf7ad-5a2a-4462-9006-e830f93a4905 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.478502 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-096bf7ad-5a2a-4462-9006-e830f93a4905 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.506251 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f75cae19-1096-49f8-a66e-39a7305cad2e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.518682 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-096bf7ad-5a2a-4462-9006-e830f93a4905 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=0b4d743f33a141d7b3045db70f68a703&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2477689 Dec 08 11:36:57.521180 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55676) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:57.526950 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-096bf7ad-5a2a-4462-9006-e830f93a4905 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7cd0f602-ec06-4b5e-a191-402b173e7e80,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:57.545037 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f75cae19-1096-49f8-a66e-39a7305cad2e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.604867 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f1efaa35-57ce-44e0-b9f3-213fe8860ea5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.629250 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f1efaa35-57ce-44e0-b9f3-213fe8860ea5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.635415 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f75cae19-1096-49f8-a66e-39a7305cad2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.638211 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f75cae19-1096-49f8-a66e-39a7305cad2e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.639434 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-f75cae19-1096-49f8-a66e-39a7305cad2e admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/74ef08f2-674c-477e-a660-9ffd3a33724c HTTP/1.1" status: 204 len: 168 time: 0.1857765 Dec 08 11:36:57.655735 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f75cae19-1096-49f8-a66e-39a7305cad2e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74ef08f2-674c-477e-a660-9ffd3a33724c,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:57.690580 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f1efaa35-57ce-44e0-b9f3-213fe8860ea5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.693211 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f1efaa35-57ce-44e0-b9f3-213fe8860ea5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:57.694514 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-f1efaa35-57ce-44e0-b9f3-213fe8860ea5 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/7cd0f602-ec06-4b5e-a191-402b173e7e80 HTTP/1.1" status: 204 len: 168 time: 0.1721957 Dec 08 11:36:57.702931 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1efaa35-57ce-44e0-b9f3-213fe8860ea5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cd0f602-ec06-4b5e-a191-402b173e7e80,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:58.017927 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55688) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:58.058369 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-3c820f70-1c79-494e-b9be-d80a42601201 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=f6029d81aac141ea8f8c02f2b4f8f6cb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0391228 Dec 08 11:36:58.061036 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55690) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:58.069805 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55692) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:58.082849 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4e4f7223-6e69-4be1-b8ae-3c87982f7e6e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:58.113040 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-083cb6d1-ed04-4525-8a29-de1e40b2c239 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:58.162238 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4e4f7223-6e69-4be1-b8ae-3c87982f7e6e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:58.162499 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:58.167119 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4e4f7223-6e69-4be1-b8ae-3c87982f7e6e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:58.213553 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e4f7223-6e69-4be1-b8ae-3c87982f7e6e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d27e1cb-039d-4ead-89e4-ad7ff53d9736,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:58.220302 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-4e4f7223-6e69-4be1-b8ae-3c87982f7e6e admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=a6ee8bbbdf764b6a9825bd546ee6332f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1487439 Dec 08 11:36:58.223600 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55696) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:36:58.274476 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1c4f6878-9ec4-4849-9251-a540de56fa87 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:58.296976 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1c4f6878-9ec4-4849-9251-a540de56fa87 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:58.310639 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-083cb6d1-ed04-4525-8a29-de1e40b2c239 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:58.343184 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1c4f6878-9ec4-4849-9251-a540de56fa87 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:58.346337 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1c4f6878-9ec4-4849-9251-a540de56fa87 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:58.347517 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-1c4f6878-9ec4-4849-9251-a540de56fa87 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/4d27e1cb-039d-4ead-89e4-ad7ff53d9736 HTTP/1.1" status: 204 len: 168 time: 0.1228964 Dec 08 11:36:58.354939 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c4f6878-9ec4-4849-9251-a540de56fa87 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d27e1cb-039d-4ead-89e4-ad7ff53d9736,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:36:58.365868 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-083cb6d1-ed04-4525-8a29-de1e40b2c239 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:58.368762 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-083cb6d1-ed04-4525-8a29-de1e40b2c239 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:36:58.372248 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-083cb6d1-ed04-4525-8a29-de1e40b2c239 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/2c041977-968d-4095-b0b6-f19afd4005c8 HTTP/1.1" status: 204 len: 168 time: 0.3078892 Dec 08 11:36:58.380994 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-083cb6d1-ed04-4525-8a29-de1e40b2c239 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c041977-968d-4095-b0b6-f19afd4005c8,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:00.706008 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device a6ac8770-1fec-45c1-8b57-a96317ee73ed no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:37:00.728097 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: a6ac8770-1fec-45c1-8b57-a96317ee73ed {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:37:00.728311 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device a6ac8770-1fec-45c1-8b57-a96317ee73ed not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:37:10.797227 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55954) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:10.914382 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4554df8c-3ad7-4fc1-b4e7-c5963965f963 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:10.991344 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4554df8c-3ad7-4fc1-b4e7-c5963965f963 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:10.994980 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4554df8c-3ad7-4fc1-b4e7-c5963965f963 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:11.033780 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-4554df8c-3ad7-4fc1-b4e7-c5963965f963 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=e7282ce90b5f4c0ba9b7af59c4e38ca8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2354317 Dec 08 11:37:11.034631 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4554df8c-3ad7-4fc1-b4e7-c5963965f963 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2146b6ed-a566-40f5-bd48-278daf5d502a,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:11.036453 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55962) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:11.083258 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9af0c598-df2d-4a65-80cf-1488424cb235 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:11.103515 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9af0c598-df2d-4a65-80cf-1488424cb235 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:11.150649 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9af0c598-df2d-4a65-80cf-1488424cb235 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:11.153329 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9af0c598-df2d-4a65-80cf-1488424cb235 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:11.154494 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-9af0c598-df2d-4a65-80cf-1488424cb235 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/2146b6ed-a566-40f5-bd48-278daf5d502a HTTP/1.1" status: 204 len: 168 time: 0.1169682 Dec 08 11:37:11.161753 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9af0c598-df2d-4a65-80cf-1488424cb235 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2146b6ed-a566-40f5-bd48-278daf5d502a,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:11.407075 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 55970) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:11.420815 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1a69b3ce-9df2-44b4-8a07-a6f011efb622 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:11.493073 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1a69b3ce-9df2-44b4-8a07-a6f011efb622 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:11.497364 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-1a69b3ce-9df2-44b4-8a07-a6f011efb622 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:11.539900 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-1a69b3ce-9df2-44b4-8a07-a6f011efb622 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=f2a4bf0305024278a2140277f56fbcac&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1317255 Dec 08 11:37:11.540730 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a69b3ce-9df2-44b4-8a07-a6f011efb622 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=649908be-4d43-4bf0-8b60-4e44848ab106,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:11.542681 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 55972) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:11.593511 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c1b391c7-03e8-46ab-b3cd-b3b1c24508ff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:11.616522 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c1b391c7-03e8-46ab-b3cd-b3b1c24508ff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:11.665132 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c1b391c7-03e8-46ab-b3cd-b3b1c24508ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:11.667805 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c1b391c7-03e8-46ab-b3cd-b3b1c24508ff admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:11.668969 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-c1b391c7-03e8-46ab-b3cd-b3b1c24508ff admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/649908be-4d43-4bf0-8b60-4e44848ab106 HTTP/1.1" status: 204 len: 168 time: 0.1252944 Dec 08 11:37:11.677849 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1b391c7-03e8-46ab-b3cd-b3b1c24508ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=649908be-4d43-4bf0-8b60-4e44848ab106,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:11.999070 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56000) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:12.013121 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a5471b28-1cab-41d9-9d53-6ae564353e39 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:12.099438 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a5471b28-1cab-41d9-9d53-6ae564353e39 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:12.102392 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a5471b28-1cab-41d9-9d53-6ae564353e39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:12.139984 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-a5471b28-1cab-41d9-9d53-6ae564353e39 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=1903b2e969db49ba9597f53390ea0f7f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1397855 Dec 08 11:37:12.141215 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5471b28-1cab-41d9-9d53-6ae564353e39 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6cf94ed-24f7-48a4-82c1-4bb9800aaa32,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:12.144193 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56004) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:12.196287 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-66858077-9d53-40ef-bf96-ebdee10debd1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:12.218159 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-66858077-9d53-40ef-bf96-ebdee10debd1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:12.269803 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-66858077-9d53-40ef-bf96-ebdee10debd1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:12.272286 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-66858077-9d53-40ef-bf96-ebdee10debd1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:12.273436 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-66858077-9d53-40ef-bf96-ebdee10debd1 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/e6cf94ed-24f7-48a4-82c1-4bb9800aaa32 HTTP/1.1" status: 204 len: 168 time: 0.1284370 Dec 08 11:37:12.280777 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66858077-9d53-40ef-bf96-ebdee10debd1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6cf94ed-24f7-48a4-82c1-4bb9800aaa32,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:12.915199 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56028) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:13.018247 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1821867202-network', 'tenant_id': '17fd28f2b10149778c99f9239b2063ea'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:37:13.039385 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Made reservation on behalf of 17fd28f2b10149778c99f9239b2063ea for: {'network': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:37:13.041758 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:13.050621 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:13.139110 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:13.143557 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:13.168037 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] vlan segment allocate from pool success with {'vlan_id': 256, 'physical_network': 'physnet1'} {{(pid=102318) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:37:13.178370 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3015918f-47b0-4cc4-a5b5-58a8947c70d0,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:13.183064 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:13.183400 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.segments_db [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Added segment 04adc6cd-8385-4ba4-8fbb-3d90574d598e of type vlan for network 1836d033-8e32-41b9-9311-f4cb6407bf23 Dec 08 11:37:13.221084 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:13.245350 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:13.246309 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:13.246937 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:13.297387 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3810682 Dec 08 11:37:13.301081 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 56046) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:13.305960 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-6b7a4bc5-92c4-4a26-9f19-7ef7c5b0ac36 admin admin] Request body: {'subnet': {'network_id': '1836d033-8e32-41b9-9311-f4cb6407bf23', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1821867202-subnet', 'tenant_id': '17fd28f2b10149778c99f9239b2063ea', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:37:13.309987 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b55f0374-da6e-4287-97e8-e3558f89ed05 admin admin] Pushing event updated for resources: {'Network': ['ID=1836d033-8e32-41b9-9311-f4cb6407bf23,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:13.320459 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network 1836d033-8e32-41b9-9311-f4cb6407bf23 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:37:13.330862 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b7a4bc5-92c4-4a26-9f19-7ef7c5b0ac36 admin admin] Made reservation on behalf of 17fd28f2b10149778c99f9239b2063ea for: {'subnet': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:37:13.333241 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6b7a4bc5-92c4-4a26-9f19-7ef7c5b0ac36 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5419653'] for subnet, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:13.496529 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6b7a4bc5-92c4-4a26-9f19-7ef7c5b0ac36 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5645724', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5419667'] for subnet, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:13.551656 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b7a4bc5-92c4-4a26-9f19-7ef7c5b0ac36 admin admin] Pushing event updated for resources: {'Subnet': ['ID=649ee17c-a317-443d-8591-1e293c7a514b,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:13.558617 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b7a4bc5-92c4-4a26-9f19-7ef7c5b0ac36 admin admin] Checking segment: {'id': '04adc6cd-8385-4ba4-8fbb-3d90574d598e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 256, 'network_id': '1836d033-8e32-41b9-9311-f4cb6407bf23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:37:13.558966 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b7a4bc5-92c4-4a26-9f19-7ef7c5b0ac36 admin admin] Network hostable DHCP agents. Network: 1836d033-8e32-41b9-9311-f4cb6407bf23, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102317) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:37:13.574626 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b7a4bc5-92c4-4a26-9f19-7ef7c5b0ac36 admin admin] Network 1836d033-8e32-41b9-9311-f4cb6407bf23 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102317) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:37:13.582693 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-6b7a4bc5-92c4-4a26-9f19-7ef7c5b0ac36 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, 1836d033-8e32-41b9-9311-f4cb6407bf23) {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:37:13.588814 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b7a4bc5-92c4-4a26-9f19-7ef7c5b0ac36 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:13.589491 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6b7a4bc5-92c4-4a26-9f19-7ef7c5b0ac36 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:13.591202 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0471cbb6-6cc7-445f-bd06-cadd39ed3768 None None] Network 1836d033-8e32-41b9-9311-f4cb6407bf23 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:37:13.609657 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-6b7a4bc5-92c4-4a26-9f19-7ef7c5b0ac36 admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3074579 Dec 08 11:37:13.689471 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0cdfa9ae-d9b3-4ff6-a50b-344e37a7297a None None] Network 1836d033-8e32-41b9-9311-f4cb6407bf23 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:37:14.053496 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56062) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:14.058392 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-160571070-network', 'tenant_id': '6d43d8385a47482c998e5b00ac56a57a'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:37:14.078533 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Made reservation on behalf of 6d43d8385a47482c998e5b00ac56a57a for: {'network': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:37:14.081609 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:14.090576 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:14.168773 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:14.174001 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:14.199958 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] vlan segment allocate from pool success with {'vlan_id': 258, 'physical_network': 'physnet1'} {{(pid=102318) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:37:14.208997 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c5264311-7ea1-4bdf-a8b9-5a85cbb39a5e,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:14.214904 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:14.215242 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.segments_db [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Added segment f6d282d7-7188-481f-b32d-96b5c18e0b7a of type vlan for network 3ae9913a-bc20-4909-a14d-48e5b7342078 Dec 08 11:37:14.254458 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:14.278514 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:14.279684 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:14.280275 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:14.344745 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.2900600 Dec 08 11:37:14.348043 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 56072) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:14.350259 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58ff63c2-37f6-481e-ac66-cbe5bc886082 admin admin] Pushing event updated for resources: {'Network': ['ID=3ae9913a-bc20-4909-a14d-48e5b7342078,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:14.353136 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-f17b920c-e3ae-4504-857c-5bcf25203e71 admin admin] Request body: {'subnet': {'network_id': '3ae9913a-bc20-4909-a14d-48e5b7342078', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-160571070-subnet', 'tenant_id': '6d43d8385a47482c998e5b00ac56a57a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:37:14.360726 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network 3ae9913a-bc20-4909-a14d-48e5b7342078 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:37:14.374526 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f17b920c-e3ae-4504-857c-5bcf25203e71 admin admin] Made reservation on behalf of 6d43d8385a47482c998e5b00ac56a57a for: {'subnet': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:37:14.376954 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f17b920c-e3ae-4504-857c-5bcf25203e71 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5419653'] for subnet, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:14.548539 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f17b920c-e3ae-4504-857c-5bcf25203e71 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5645724', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5419667'] for subnet, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:14.601744 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f17b920c-e3ae-4504-857c-5bcf25203e71 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e934f747-8b65-4587-b4be-fe125e401bc3,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:14.610056 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f17b920c-e3ae-4504-857c-5bcf25203e71 admin admin] Checking segment: {'id': 'f6d282d7-7188-481f-b32d-96b5c18e0b7a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': '3ae9913a-bc20-4909-a14d-48e5b7342078'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:37:14.610459 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f17b920c-e3ae-4504-857c-5bcf25203e71 admin admin] Network hostable DHCP agents. Network: 3ae9913a-bc20-4909-a14d-48e5b7342078, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102317) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:37:14.627394 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f17b920c-e3ae-4504-857c-5bcf25203e71 admin admin] Network 3ae9913a-bc20-4909-a14d-48e5b7342078 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102317) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:37:14.635042 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-f17b920c-e3ae-4504-857c-5bcf25203e71 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, 3ae9913a-bc20-4909-a14d-48e5b7342078) {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:37:14.638824 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f17b920c-e3ae-4504-857c-5bcf25203e71 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:14.640305 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f17b920c-e3ae-4504-857c-5bcf25203e71 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:14.644317 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61709eb7-f1ac-44c6-8487-fca58262da87 None None] Network 3ae9913a-bc20-4909-a14d-48e5b7342078 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:37:14.655482 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-f17b920c-e3ae-4504-857c-5bcf25203e71 admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3062854 Dec 08 11:37:14.739708 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-920d1eac-3377-4b55-a144-7575116554d2 None None] Network 3ae9913a-bc20-4909-a14d-48e5b7342078 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:37:15.894957 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:37:16.568160 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3051d510-d1c8-48bc-af0f-374f99dca553 req-e8240e70-5b3e-4b0a-90a0-5de980673d7b service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0411937 Dec 08 11:37:16.631395 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3051d510-d1c8-48bc-af0f-374f99dca553 req-c5fd9bc7-1e6b-43aa-a2bd-246aec9ea297 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:16.632867 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3051d510-d1c8-48bc-af0f-374f99dca553 req-c5fd9bc7-1e6b-43aa-a2bd-246aec9ea297 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 1100 time: 0.0391104 Dec 08 11:37:16.741222 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3051d510-d1c8-48bc-af0f-374f99dca553 req-467818d8-9efa-474e-8883-6e80454858cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:16.742644 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3051d510-d1c8-48bc-af0f-374f99dca553 req-467818d8-9efa-474e-8883-6e80454858cc service neutron] 10.222.0.61 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 917 time: 0.0842721 Dec 08 11:37:16.808371 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3051d510-d1c8-48bc-af0f-374f99dca553 req-5545cf35-c89a-40f3-9b4c-83c7f5f1b8f3 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe HTTP/1.1" status: 200 len: 1001 time: 0.0557280 Dec 08 11:37:16.857487 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3051d510-d1c8-48bc-af0f-374f99dca553 req-3bf8fb2d-a7db-4d0f-b7ac-ce1aea35fe87 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:16.858917 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3051d510-d1c8-48bc-af0f-374f99dca553 req-3bf8fb2d-a7db-4d0f-b7ac-ce1aea35fe87 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 200 len: 855 time: 0.0420170 Dec 08 11:37:16.911398 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3051d510-d1c8-48bc-af0f-374f99dca553 req-82cae089-0f58-4d80-858b-879500bbdfca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:16.913061 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3051d510-d1c8-48bc-af0f-374f99dca553 req-82cae089-0f58-4d80-858b-879500bbdfca service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=fd37a1fc-3614-462b-92a2-b41260c949a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0451944 Dec 08 11:37:17.002190 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3051d510-d1c8-48bc-af0f-374f99dca553 req-58fb0b24-69d7-4067-852b-387cca62877e service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0785108 Dec 08 11:37:17.095637 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3051d510-d1c8-48bc-af0f-374f99dca553 req-4991ad75-82a2-4877-891b-20c262dfa2ac service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845039 Dec 08 11:37:17.589825 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:22.469204 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e9dd6232-dc83-4fdc-a15b-6b2c1904c971 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:24.690501 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-155bda38-df96-448d-a4cc-8bd693e34721 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:25.783206 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:27.144315 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:27.637550 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56338) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:27.683061 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_v2 [None req-a287a216-358d-4047-9d92-ae48ea10ae48 admin admin] Deleting subnet 095735e3-fae9-450c-a1b3-5a4932e6f812 {{(pid=102318) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:37:27.685980 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a287a216-358d-4047-9d92-ae48ea10ae48 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:27.718446 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a287a216-358d-4047-9d92-ae48ea10ae48 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16370044'] for subnet, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:27.754739 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a287a216-358d-4047-9d92-ae48ea10ae48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:27.809106 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a287a216-358d-4047-9d92-ae48ea10ae48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4572160', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-16496636'] for subnet, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:27.834670 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a287a216-358d-4047-9d92-ae48ea10ae48 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=095735e3-fae9-450c-a1b3-5a4932e6f812,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:27.837170 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a287a216-358d-4047-9d92-ae48ea10ae48 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:27.840270 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-a287a216-358d-4047-9d92-ae48ea10ae48 admin admin] 10.222.0.66 "DELETE /v2.0/subnets/095735e3-fae9-450c-a1b3-5a4932e6f812 HTTP/1.1" status: 204 len: 168 time: 0.2017181 Dec 08 11:37:27.842763 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56340) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:27.906916 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fccc8baa-b485-4f41-8c79-7b248622d05d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:27.984547 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fccc8baa-b485-4f41-8c79-7b248622d05d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:28.004008 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-fccc8baa-b485-4f41-8c79-7b248622d05d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a19166f1-a36a-4f08-8a61-f4d3fa1e8383']}} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:37:28.012790 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-fccc8baa-b485-4f41-8c79-7b248622d05d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '93ea5ca7-22ef-4002-8579-aa09922044a7') {'for_net_delete': True} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:37:28.013080 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-fccc8baa-b485-4f41-8c79-7b248622d05d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '93ea5ca7-22ef-4002-8579-aa09922044a7') {} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:37:28.022219 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fccc8baa-b485-4f41-8c79-7b248622d05d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16370039'] for segment, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:28.034897 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fccc8baa-b485-4f41-8c79-7b248622d05d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:28.041057 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fccc8baa-b485-4f41-8c79-7b248622d05d admin admin] Releasing vlan 269 on physical network physnet1 to pool {{(pid=102318) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:37:28.041457 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fccc8baa-b485-4f41-8c79-7b248622d05d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4575654'] for segment, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: Traceback (most recent call last): Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: timer() Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: cb(*args, **kw) Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: return func(*args, **kwargs) Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: self._notify() Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: self.callback(batched_events) Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: event.method(event) Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: return f(self, *a, **k) Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._get(url).json() Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: return self.request(url, 'GET', **kwargs) Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:37:28.043045 dv-cinder-819778-3-iscsi neutron-server[102318]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:37:28.095544 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fccc8baa-b485-4f41-8c79-7b248622d05d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:28.101039 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fccc8baa-b485-4f41-8c79-7b248622d05d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:28.104888 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-fccc8baa-b485-4f41-8c79-7b248622d05d admin admin] 10.222.0.66 "DELETE /v2.0/networks/a19166f1-a36a-4f08-8a61-f4d3fa1e8383 HTTP/1.1" status: 204 len: 168 time: 0.2612169 Dec 08 11:37:28.116495 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fccc8baa-b485-4f41-8c79-7b248622d05d admin admin] Pushing event deleted for resources: {'Network': ['ID=a19166f1-a36a-4f08-8a61-f4d3fa1e8383,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:28.155733 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:28.274617 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 56350) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:28.320057 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-5f9ec567-7a9e-46cd-8b62-6d6d1cd8d82d admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=b1b41ae149164acbb31b021c9049b500&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0437055 Dec 08 11:37:28.322456 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 56354) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:28.373904 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a3bf11da-eaf9-4d46-a982-9d78579800a6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:28.394066 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a3bf11da-eaf9-4d46-a982-9d78579800a6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:28.439191 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a3bf11da-eaf9-4d46-a982-9d78579800a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:28.442005 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-a3bf11da-eaf9-4d46-a982-9d78579800a6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:28.443122 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-a3bf11da-eaf9-4d46-a982-9d78579800a6 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/17fd259e-0c88-4f2b-9716-9b0c3abb9504 HTTP/1.1" status: 204 len: 168 time: 0.1197741 Dec 08 11:37:28.450662 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3bf11da-eaf9-4d46-a982-9d78579800a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17fd259e-0c88-4f2b-9716-9b0c3abb9504,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:30.265052 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 56428) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:30.308372 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_v2 [None req-874fd6a8-53ac-4e38-bf70-5f44d763b435 admin admin] Deleting subnet 649ee17c-a317-443d-8591-1e293c7a514b {{(pid=102317) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:37:30.311650 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-874fd6a8-53ac-4e38-bf70-5f44d763b435 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.346081 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-874fd6a8-53ac-4e38-bf70-5f44d763b435 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4850389'] for subnet, precommit_delete_associations {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.386233 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-874fd6a8-53ac-4e38-bf70-5f44d763b435 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.436182 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-874fd6a8-53ac-4e38-bf70-5f44d763b435 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5645791', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5419674'] for subnet, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.459476 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-874fd6a8-53ac-4e38-bf70-5f44d763b435 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=649ee17c-a317-443d-8591-1e293c7a514b,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:30.465376 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-874fd6a8-53ac-4e38-bf70-5f44d763b435 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.468754 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-874fd6a8-53ac-4e38-bf70-5f44d763b435 admin admin] 10.222.0.66 "DELETE /v2.0/subnets/649ee17c-a317-443d-8591-1e293c7a514b HTTP/1.1" status: 204 len: 168 time: 0.2024217 Dec 08 11:37:30.471217 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 56430) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:30.538252 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5c5f1aff-7e73-4e3e-938d-3015cc6d8f9e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.618470 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5c5f1aff-7e73-4e3e-938d-3015cc6d8f9e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.649264 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-5c5f1aff-7e73-4e3e-938d-3015cc6d8f9e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1836d033-8e32-41b9-9311-f4cb6407bf23']}} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:37:30.658779 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-5c5f1aff-7e73-4e3e-938d-3015cc6d8f9e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '04adc6cd-8385-4ba4-8fbb-3d90574d598e') {'for_net_delete': True} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:37:30.659091 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-5c5f1aff-7e73-4e3e-938d-3015cc6d8f9e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '04adc6cd-8385-4ba4-8fbb-3d90574d598e') {} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:37:30.669669 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5c5f1aff-7e73-4e3e-938d-3015cc6d8f9e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4850398'] for segment, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.686475 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5c5f1aff-7e73-4e3e-938d-3015cc6d8f9e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.693319 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5c5f1aff-7e73-4e3e-938d-3015cc6d8f9e admin admin] Releasing vlan 256 on physical network physnet1 to pool {{(pid=102317) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:37:30.693705 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5c5f1aff-7e73-4e3e-938d-3015cc6d8f9e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5648505'] for segment, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: Traceback (most recent call last): Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: timer() Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: cb(*args, **kw) Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: return func(*args, **kwargs) Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: self._notify() Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: self.callback(batched_events) Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: event.method(event) Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: return f(self, *a, **k) Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._get(url).json() Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: return self.request(url, 'GET', **kwargs) Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:37:30.696194 dv-cinder-819778-3-iscsi neutron-server[102317]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:37:30.755720 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5c5f1aff-7e73-4e3e-938d-3015cc6d8f9e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.762117 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-5c5f1aff-7e73-4e3e-938d-3015cc6d8f9e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.766084 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-5c5f1aff-7e73-4e3e-938d-3015cc6d8f9e admin admin] 10.222.0.66 "DELETE /v2.0/networks/1836d033-8e32-41b9-9311-f4cb6407bf23 HTTP/1.1" status: 204 len: 168 time: 0.2937009 Dec 08 11:37:30.769137 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56440) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:30.778530 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c5f1aff-7e73-4e3e-938d-3015cc6d8f9e admin admin] Pushing event deleted for resources: {'Network': ['ID=1836d033-8e32-41b9-9311-f4cb6407bf23,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:30.817948 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_v2 [None req-9ddd2bcb-24a5-4a6e-9f85-410a91b8a30c admin admin] Deleting subnet e934f747-8b65-4587-b4be-fe125e401bc3 {{(pid=102318) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:37:30.821101 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9ddd2bcb-24a5-4a6e-9f85-410a91b8a30c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.854896 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9ddd2bcb-24a5-4a6e-9f85-410a91b8a30c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16370044'] for subnet, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.893060 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9ddd2bcb-24a5-4a6e-9f85-410a91b8a30c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.942461 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9ddd2bcb-24a5-4a6e-9f85-410a91b8a30c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4572160', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-16496636'] for subnet, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.971548 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ddd2bcb-24a5-4a6e-9f85-410a91b8a30c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e934f747-8b65-4587-b4be-fe125e401bc3,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:30.973488 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9ddd2bcb-24a5-4a6e-9f85-410a91b8a30c admin admin] Publish callbacks [] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:30.977130 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-9ddd2bcb-24a5-4a6e-9f85-410a91b8a30c admin admin] 10.222.0.66 "DELETE /v2.0/subnets/e934f747-8b65-4587-b4be-fe125e401bc3 HTTP/1.1" status: 204 len: 168 time: 0.2063153 Dec 08 11:37:30.979660 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56442) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:31.045228 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b7fb99ea-a1f0-4fda-b7f0-621e5157c35a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:31.124163 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b7fb99ea-a1f0-4fda-b7f0-621e5157c35a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:31.144315 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-b7fb99ea-a1f0-4fda-b7f0-621e5157c35a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3ae9913a-bc20-4909-a14d-48e5b7342078']}} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:37:31.153649 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-b7fb99ea-a1f0-4fda-b7f0-621e5157c35a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f6d282d7-7188-481f-b32d-96b5c18e0b7a') {'for_net_delete': True} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:37:31.153943 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-b7fb99ea-a1f0-4fda-b7f0-621e5157c35a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f6d282d7-7188-481f-b32d-96b5c18e0b7a') {} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:37:31.162887 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b7fb99ea-a1f0-4fda-b7f0-621e5157c35a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16370039'] for segment, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:31.176160 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b7fb99ea-a1f0-4fda-b7f0-621e5157c35a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:31.182894 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b7fb99ea-a1f0-4fda-b7f0-621e5157c35a admin admin] Releasing vlan 258 on physical network physnet1 to pool {{(pid=102318) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:37:31.183471 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b7fb99ea-a1f0-4fda-b7f0-621e5157c35a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4575654'] for segment, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: Traceback (most recent call last): Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: timer() Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: cb(*args, **kw) Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: return func(*args, **kwargs) Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: self._notify() Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: self.callback(batched_events) Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: event.method(event) Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: return f(self, *a, **k) Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._get(url).json() Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: return self.request(url, 'GET', **kwargs) Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:37:31.186056 dv-cinder-819778-3-iscsi neutron-server[102318]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:37:31.238535 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b7fb99ea-a1f0-4fda-b7f0-621e5157c35a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:31.243753 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b7fb99ea-a1f0-4fda-b7f0-621e5157c35a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:31.246920 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-b7fb99ea-a1f0-4fda-b7f0-621e5157c35a admin admin] 10.222.0.66 "DELETE /v2.0/networks/3ae9913a-bc20-4909-a14d-48e5b7342078 HTTP/1.1" status: 204 len: 168 time: 0.2663631 Dec 08 11:37:31.257702 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7fb99ea-a1f0-4fda-b7f0-621e5157c35a admin admin] Pushing event deleted for resources: {'Network': ['ID=3ae9913a-bc20-4909-a14d-48e5b7342078,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:31.407562 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56446) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:31.448238 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-d42882fb-54e4-491e-be3a-42ed3f8762b8 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=17fd28f2b10149778c99f9239b2063ea&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0395219 Dec 08 11:37:31.450634 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56448) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:31.500218 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0cfe483b-64e4-4ed0-81e6-cc293958de38 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:31.520662 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0cfe483b-64e4-4ed0-81e6-cc293958de38 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:31.565497 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0cfe483b-64e4-4ed0-81e6-cc293958de38 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:31.568268 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0cfe483b-64e4-4ed0-81e6-cc293958de38 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:31.569414 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-0cfe483b-64e4-4ed0-81e6-cc293958de38 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/3015918f-47b0-4cc4-a5b5-58a8947c70d0 HTTP/1.1" status: 204 len: 168 time: 0.1178706 Dec 08 11:37:31.577969 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cfe483b-64e4-4ed0-81e6-cc293958de38 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3015918f-47b0-4cc4-a5b5-58a8947c70d0,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:31.872305 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 56458) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:31.911716 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-b3f21b72-476e-4c32-afc4-324c5f0336b7 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=6d43d8385a47482c998e5b00ac56a57a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0382688 Dec 08 11:37:31.913941 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 56460) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:31.959162 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-20839f18-c274-4ec2-8038-16e104c6eb48 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:31.979691 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-20839f18-c274-4ec2-8038-16e104c6eb48 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:32.024408 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-20839f18-c274-4ec2-8038-16e104c6eb48 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:32.026993 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-20839f18-c274-4ec2-8038-16e104c6eb48 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:32.028117 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-20839f18-c274-4ec2-8038-16e104c6eb48 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/c5264311-7ea1-4bdf-a8b9-5a85cbb39a5e HTTP/1.1" status: 204 len: 168 time: 0.1132588 Dec 08 11:37:32.035407 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20839f18-c274-4ec2-8038-16e104c6eb48 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c5264311-7ea1-4bdf-a8b9-5a85cbb39a5e,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:47.595459 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:49.865811 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c7ee474-581d-4bda-8b96-d20c7e29c757 req-5bfd2b75-1e11-4b72-be1c-4d0b4ed6a563 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:49.867881 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6c7ee474-581d-4bda-8b96-d20c7e29c757 req-5bfd2b75-1e11-4b72-be1c-4d0b4ed6a563 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0491865 Dec 08 11:37:49.914840 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6c7ee474-581d-4bda-8b96-d20c7e29c757 req-d62e55ba-1b0c-4a3f-bfdd-63d9b492d9f5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408454 Dec 08 11:37:50.718738 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 56704) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:50.826003 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-418aded8-0cfd-4867-a59f-c41725e652e7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:50.901949 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-418aded8-0cfd-4867-a59f-c41725e652e7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:50.905688 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-418aded8-0cfd-4867-a59f-c41725e652e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:50.946555 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-418aded8-0cfd-4867-a59f-c41725e652e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=884a5cb2-dfac-4693-9cf6-f8c216ec2be6,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:50.954634 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56722) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:50.968065 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-418aded8-0cfd-4867-a59f-c41725e652e7 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=6d1072e9e4cc4a1aafd8f7a0d125ca4e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2416890 Dec 08 11:37:51.038054 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:51.065364 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:51.073678 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bc90771-c0ca-4001-aa6b-78f92496e60e req-42e5ef21-212b-44ae-a24c-c207f32cb070 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:51.075116 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6bc90771-c0ca-4001-aa6b-78f92496e60e req-42e5ef21-212b-44ae-a24c-c207f32cb070 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0829012 Dec 08 11:37:51.142189 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6bc90771-c0ca-4001-aa6b-78f92496e60e req-494b3363-f91d-4c9e-a7a4-99727ffff841 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0602717 Dec 08 11:37:51.152748 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:51.159558 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:51.162560 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/884a5cb2-dfac-4693-9cf6-f8c216ec2be6 HTTP/1.1" status: 204 len: 168 time: 0.2050431 Dec 08 11:37:51.171006 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=884a5cb2-dfac-4693-9cf6-f8c216ec2be6,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:51.178668 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:37:51.179615 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:37:51.179961 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:37:51.180400 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:37:51.180638 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:37:51.180963 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:37:51.181344 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:37:51.181677 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:37:51.182013 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:37:51.182336 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:37:51.182662 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:37:51.182985 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:37:51.183305 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-319627bd-1846-487f-a54b-d4442826b654 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:37:51.409580 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56732) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:51.424272 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-223ec15b-9ea8-44c3-ab34-bed4903afbd2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:51.497436 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-223ec15b-9ea8-44c3-ab34-bed4903afbd2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:51.500981 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-223ec15b-9ea8-44c3-ab34-bed4903afbd2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:51.537906 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-223ec15b-9ea8-44c3-ab34-bed4903afbd2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d6a41c3-40d4-4fcd-ad0a-27946d639cf0,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:51.544354 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-223ec15b-9ea8-44c3-ab34-bed4903afbd2 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=835097142e2442dbb113de6623d081f2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1327438 Dec 08 11:37:51.546280 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56736) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:37:51.594408 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d38a3bf6-142f-4c75-a1cc-7d71183ebf6f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:51.615965 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d38a3bf6-142f-4c75-a1cc-7d71183ebf6f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:51.661259 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d38a3bf6-142f-4c75-a1cc-7d71183ebf6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:51.664338 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d38a3bf6-142f-4c75-a1cc-7d71183ebf6f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:51.665483 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-d38a3bf6-142f-4c75-a1cc-7d71183ebf6f admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/8d6a41c3-40d4-4fcd-ad0a-27946d639cf0 HTTP/1.1" status: 204 len: 168 time: 0.1185777 Dec 08 11:37:51.672660 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d38a3bf6-142f-4c75-a1cc-7d71183ebf6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d6a41c3-40d4-4fcd-ad0a-27946d639cf0,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:37:52.257796 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd5de23-b3be-4b5b-81f4-89d4f1c5634c req-4ee98821-7b76-41e3-8613-14302ecad4ac tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:52.259462 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5cd5de23-b3be-4b5b-81f4-89d4f1c5634c req-4ee98821-7b76-41e3-8613-14302ecad4ac tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0501745 Dec 08 11:37:52.311288 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5cd5de23-b3be-4b5b-81f4-89d4f1c5634c req-0628ba7f-984e-4945-9738-5d0702d7bd8d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452204 Dec 08 11:37:52.463512 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-43d56307-4781-4bcf-8a07-7b37e1755b31 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:52.894062 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:37:53.427850 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acec5719-f461-4ea4-a0a7-d56685bac861 req-8965b249-e6cc-4b31-b935-2931e49ba41d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:53.429881 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-acec5719-f461-4ea4-a0a7-d56685bac861 req-8965b249-e6cc-4b31-b935-2931e49ba41d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0516920 Dec 08 11:37:53.474230 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-acec5719-f461-4ea4-a0a7-d56685bac861 req-91a33cb2-6a16-4990-82c0-46cc97a0596c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385404 Dec 08 11:37:54.586470 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77da3690-e173-40a1-94e9-31b36cd7c3c0 req-7f13d3a9-648e-4f68-93e9-f259b1312d83 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:54.587899 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-77da3690-e173-40a1-94e9-31b36cd7c3c0 req-7f13d3a9-648e-4f68-93e9-f259b1312d83 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0474017 Dec 08 11:37:54.635213 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-77da3690-e173-40a1-94e9-31b36cd7c3c0 req-64aa9792-aa1f-4b83-9921-efba0bd0b306 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412993 Dec 08 11:37:54.690794 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-885b12cb-3230-4c96-ab8d-2cbf3af525d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:55.748157 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b900271-58bc-4ef3-8055-e801f10edabe req-eb3175a1-533d-4e03-8f86-4dff26bb1d76 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:55.749630 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3b900271-58bc-4ef3-8055-e801f10edabe req-eb3175a1-533d-4e03-8f86-4dff26bb1d76 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0474591 Dec 08 11:37:55.786816 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:55.800403 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3b900271-58bc-4ef3-8055-e801f10edabe req-6070e4cc-7d96-4542-ba51-574b98f9a605 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449502 Dec 08 11:37:56.916778 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c43fc36-b50a-42c1-966e-cd2c67688144 req-8ec9e270-1934-4c79-8c7f-cbea99d75c10 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:56.921626 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3c43fc36-b50a-42c1-966e-cd2c67688144 req-8ec9e270-1934-4c79-8c7f-cbea99d75c10 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0527043 Dec 08 11:37:56.964983 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3c43fc36-b50a-42c1-966e-cd2c67688144 req-83f190b8-5023-45f9-b6e3-7810b9ff718b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408816 Dec 08 11:37:57.144520 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:58.078108 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9398a3b3-4c1f-4047-893b-d48d3e65e564 req-f4665283-c684-4551-b732-ad0dde96e9b5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:58.079670 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9398a3b3-4c1f-4047-893b-d48d3e65e564 req-f4665283-c684-4551-b732-ad0dde96e9b5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0477445 Dec 08 11:37:58.126211 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9398a3b3-4c1f-4047-893b-d48d3e65e564 req-b8bc103f-e965-4c9f-8409-991c0dafc1c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406048 Dec 08 11:37:58.158786 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:37:59.243167 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe5dbebf-5b3b-4b6a-b361-477fc3827917 req-6fb422a4-0d9f-4134-aa1a-54f38a8b05f2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:37:59.244598 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fe5dbebf-5b3b-4b6a-b361-477fc3827917 req-6fb422a4-0d9f-4134-aa1a-54f38a8b05f2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0513585 Dec 08 11:37:59.289939 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fe5dbebf-5b3b-4b6a-b361-477fc3827917 req-e2bd6d5d-734e-4ffc-a291-0a88184ba9d5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394309 Dec 08 11:38:00.407932 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be98ee27-0b52-4302-9179-5e153698fa04 req-12ae8df7-adcf-4cb1-8246-8e6284a49b37 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:00.409440 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-be98ee27-0b52-4302-9179-5e153698fa04 req-12ae8df7-adcf-4cb1-8246-8e6284a49b37 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0482342 Dec 08 11:38:00.462604 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-be98ee27-0b52-4302-9179-5e153698fa04 req-0bbf71f1-1e7a-4653-8524-f36e5e02c369 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471585 Dec 08 11:38:01.576408 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f85c03e-a93e-46ea-8a8b-a7be8a1e7bf2 req-92b57d3b-7e5b-4648-a76d-e01a5da0e722 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:01.577874 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5f85c03e-a93e-46ea-8a8b-a7be8a1e7bf2 req-92b57d3b-7e5b-4648-a76d-e01a5da0e722 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0477104 Dec 08 11:38:01.626236 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5f85c03e-a93e-46ea-8a8b-a7be8a1e7bf2 req-454b1b79-bf53-4f61-9753-939ba5b7a810 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425651 Dec 08 11:38:02.739206 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dce64bf-a686-44d8-9939-5bd8d7406ea2 req-93673caf-77c6-45b6-a677-72277cbe3444 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:02.740665 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3dce64bf-a686-44d8-9939-5bd8d7406ea2 req-93673caf-77c6-45b6-a677-72277cbe3444 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0481904 Dec 08 11:38:02.788692 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3dce64bf-a686-44d8-9939-5bd8d7406ea2 req-61506219-f6c1-47fa-9797-04bf20dcb94e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415442 Dec 08 11:38:03.899973 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a38cfe95-9191-4438-aac7-ec05fca9cb22 req-0e78b923-dffe-4768-bd6f-dfb55a36a38e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:03.901435 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a38cfe95-9191-4438-aac7-ec05fca9cb22 req-0e78b923-dffe-4768-bd6f-dfb55a36a38e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0475678 Dec 08 11:38:03.947243 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a38cfe95-9191-4438-aac7-ec05fca9cb22 req-a206377a-ad43-44e5-ba78-d4e919467599 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398993 Dec 08 11:38:05.023358 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 56918) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:05.063941 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fa7570e-f049-43ae-bc9c-02a3d1edb00a req-f6920106-e660-406c-b47c-6643170fd889 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:05.065461 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3fa7570e-f049-43ae-bc9c-02a3d1edb00a req-f6920106-e660-406c-b47c-6643170fd889 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0523150 Dec 08 11:38:05.113248 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3fa7570e-f049-43ae-bc9c-02a3d1edb00a req-853c0a80-d55e-4398-9978-0b3d0c025433 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418196 Dec 08 11:38:05.133372 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:05.208356 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:05.212712 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:05.252987 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=8666479c50344a47b59e16ecbfea3631&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2285647 Dec 08 11:38:05.253868 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3945ab87-d605-4133-a72e-9e7ea8df28df,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:05.255700 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 56922) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:05.260957 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:05.261330 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:05.261669 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:05.261998 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:05.262326 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:05.262647 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:05.262968 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:05.263314 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:05.263634 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:05.263950 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:05.264265 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:05.264578 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:05.264894 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-819023bc-1c91-41fe-a841-fe4bda316a86 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:05.306967 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8a314f9f-d772-4a5c-8732-0654e12b9bbc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:05.328404 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8a314f9f-d772-4a5c-8732-0654e12b9bbc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:05.374337 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8a314f9f-d772-4a5c-8732-0654e12b9bbc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:05.376901 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8a314f9f-d772-4a5c-8732-0654e12b9bbc admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:05.380611 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-8a314f9f-d772-4a5c-8732-0654e12b9bbc admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/3945ab87-d605-4133-a72e-9e7ea8df28df HTTP/1.1" status: 204 len: 168 time: 0.1213689 Dec 08 11:38:05.386557 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a314f9f-d772-4a5c-8732-0654e12b9bbc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3945ab87-d605-4133-a72e-9e7ea8df28df,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:06.227202 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc3220a-67e0-44ba-855e-ef23eefde602 req-5eb8b70a-e052-4961-b8cc-4edaf40bd03d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:06.228643 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4fc3220a-67e0-44ba-855e-ef23eefde602 req-5eb8b70a-e052-4961-b8cc-4edaf40bd03d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0503888 Dec 08 11:38:06.274048 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4fc3220a-67e0-44ba-855e-ef23eefde602 req-509e2b14-d637-4498-9039-09414985a85f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395873 Dec 08 11:38:07.385311 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e8faba4-9950-45bf-83fd-5059f98b4932 req-22163ae1-3342-4b76-96ba-daeb5313a29c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:07.386667 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2e8faba4-9950-45bf-83fd-5059f98b4932 req-22163ae1-3342-4b76-96ba-daeb5313a29c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0477986 Dec 08 11:38:07.434803 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2e8faba4-9950-45bf-83fd-5059f98b4932 req-6b349da8-edfa-4e1d-b008-4b4a6dbe578b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417147 Dec 08 11:38:08.443190 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57000) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:08.547367 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-98ee07d4-1bc1-4aa5-b95c-fe69d95fe014 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:08.580038 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35e313f2-a1e8-428b-a345-61296740356d req-dfd6e4db-deb8-48d1-a7d4-fbfafe916e2f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:08.581471 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-35e313f2-a1e8-428b-a345-61296740356d req-dfd6e4db-deb8-48d1-a7d4-fbfafe916e2f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0761743 Dec 08 11:38:08.654207 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-35e313f2-a1e8-428b-a345-61296740356d req-73d93933-80f2-4875-bcae-cdbbc41e4228 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0662212 Dec 08 11:38:08.675247 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-98ee07d4-1bc1-4aa5-b95c-fe69d95fe014 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:08.679060 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-98ee07d4-1bc1-4aa5-b95c-fe69d95fe014 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:08.716979 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-98ee07d4-1bc1-4aa5-b95c-fe69d95fe014 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=e8eaf48978524ce69a81b7132b61e2cf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2727325 Dec 08 11:38:08.718065 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98ee07d4-1bc1-4aa5-b95c-fe69d95fe014 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ccdbfb54-e92e-426b-b7cc-aba41c0c8bfd,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:08.719779 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57006) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:08.766842 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-04166e21-8532-4e00-934f-b4c10ea3d526 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:08.788693 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-04166e21-8532-4e00-934f-b4c10ea3d526 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:08.836053 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-04166e21-8532-4e00-934f-b4c10ea3d526 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:08.838664 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-04166e21-8532-4e00-934f-b4c10ea3d526 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:08.839804 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-04166e21-8532-4e00-934f-b4c10ea3d526 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/ccdbfb54-e92e-426b-b7cc-aba41c0c8bfd HTTP/1.1" status: 204 len: 168 time: 0.1190057 Dec 08 11:38:08.847405 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04166e21-8532-4e00-934f-b4c10ea3d526 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ccdbfb54-e92e-426b-b7cc-aba41c0c8bfd,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:09.092445 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57012) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:09.106056 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-64429b2e-1c10-4a95-9829-f392516058aa admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:09.179745 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-64429b2e-1c10-4a95-9829-f392516058aa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:09.183443 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-64429b2e-1c10-4a95-9829-f392516058aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:09.224579 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-64429b2e-1c10-4a95-9829-f392516058aa admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=35f773e5ca2b4b58a702b6bca6438977&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1309018 Dec 08 11:38:09.226319 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64429b2e-1c10-4a95-9829-f392516058aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=492381a7-83bb-4813-a6d7-17b8dc8872b8,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:09.227848 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57014) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:09.276053 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7148e2dd-7381-4878-a8cb-516cf1d4d799 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:09.296757 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7148e2dd-7381-4878-a8cb-516cf1d4d799 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:09.342500 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7148e2dd-7381-4878-a8cb-516cf1d4d799 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:09.345140 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7148e2dd-7381-4878-a8cb-516cf1d4d799 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:09.346314 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-7148e2dd-7381-4878-a8cb-516cf1d4d799 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/492381a7-83bb-4813-a6d7-17b8dc8872b8 HTTP/1.1" status: 204 len: 168 time: 0.1174412 Dec 08 11:38:09.354133 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7148e2dd-7381-4878-a8cb-516cf1d4d799 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=492381a7-83bb-4813-a6d7-17b8dc8872b8,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:09.772529 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ae71a4-25ae-444f-b3a7-01e83796c33c req-24c59722-8e1f-47fc-8f87-3bc1e5152e34 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:09.774049 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-45ae71a4-25ae-444f-b3a7-01e83796c33c req-24c59722-8e1f-47fc-8f87-3bc1e5152e34 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0513766 Dec 08 11:38:09.823879 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-45ae71a4-25ae-444f-b3a7-01e83796c33c req-0d75490d-a018-4f8c-a7e9-3f8aa661ad71 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438423 Dec 08 11:38:10.940028 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12091296-e0d0-4774-a82c-92f1bab143e7 req-9b27b030-fc87-4bbc-a699-181d243709c5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:10.941514 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-12091296-e0d0-4774-a82c-92f1bab143e7 req-9b27b030-fc87-4bbc-a699-181d243709c5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0488541 Dec 08 11:38:10.987377 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-12091296-e0d0-4774-a82c-92f1bab143e7 req-02da9475-e224-43be-9a1f-4cec895f57a5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397897 Dec 08 11:38:12.106910 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a7f62c-f677-473c-ab43-7f091d83239c req-3b3d64a4-0c5a-4fb6-bb11-4705749b6747 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:12.108396 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c9a7f62c-f677-473c-ab43-7f091d83239c req-3b3d64a4-0c5a-4fb6-bb11-4705749b6747 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0498469 Dec 08 11:38:12.160657 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c9a7f62c-f677-473c-ab43-7f091d83239c req-4e2748e2-d644-481d-8482-5ef403e255e5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460923 Dec 08 11:38:13.276600 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b08181e-f512-4130-8caf-afca7eb1bdfb req-9fa918b5-e516-42c3-a732-59c6086b87b4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:13.278097 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b08181e-f512-4130-8caf-afca7eb1bdfb req-9fa918b5-e516-42c3-a732-59c6086b87b4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0502572 Dec 08 11:38:13.325926 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b08181e-f512-4130-8caf-afca7eb1bdfb req-ee550975-2d3d-47ea-bc3d-8276c8c52bcc tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418983 Dec 08 11:38:14.439360 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44a8bd9f-097b-47f1-8132-28d71001d4f6 req-0af24c02-9a9c-4f7b-b399-fe4993d877f2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:14.440811 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-44a8bd9f-097b-47f1-8132-28d71001d4f6 req-0af24c02-9a9c-4f7b-b399-fe4993d877f2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0481570 Dec 08 11:38:14.486275 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-44a8bd9f-097b-47f1-8132-28d71001d4f6 req-eed97567-f495-4662-9b30-82b458af1857 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395441 Dec 08 11:38:15.604681 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61590b5b-2ddd-4c53-8c2e-9f17faacdcb1 req-0926a743-9d76-461e-a6e2-2a71295041c6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:15.606159 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-61590b5b-2ddd-4c53-8c2e-9f17faacdcb1 req-0926a743-9d76-461e-a6e2-2a71295041c6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0515561 Dec 08 11:38:15.652158 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-61590b5b-2ddd-4c53-8c2e-9f17faacdcb1 req-3c6f581b-aaeb-4064-bf50-9dd718c845bd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402334 Dec 08 11:38:16.222662 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cd649456-d01c-492f-bc80-00c1fcc3dca9 req-a319caed-bb4d-43bd-9043-36b2b960c889 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0428667 Dec 08 11:38:16.767838 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6473f654-ccb0-4ff4-91c2-c74008827095 req-3c3b5f74-aa00-4e38-924f-580e1b08c9f4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:16.769339 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6473f654-ccb0-4ff4-91c2-c74008827095 req-3c3b5f74-aa00-4e38-924f-580e1b08c9f4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0499713 Dec 08 11:38:16.815095 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6473f654-ccb0-4ff4-91c2-c74008827095 req-ff03b89e-3ffd-40fa-a84a-4f8f1326d8cd tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392597 Dec 08 11:38:17.596887 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:17.627782 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd649456-d01c-492f-bc80-00c1fcc3dca9 req-ac508b74-31aa-472b-8f22-d3ada80ca1a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:17.629416 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cd649456-d01c-492f-bc80-00c1fcc3dca9 req-ac508b74-31aa-472b-8f22-d3ada80ca1a3 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=3102b9c0f7ea45048750ae3c81085631&device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 1138 time: 0.0437548 Dec 08 11:38:17.729963 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd649456-d01c-492f-bc80-00c1fcc3dca9 req-7af121df-c3a4-4e5d-af21-2f14bc1c64c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:17.731428 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cd649456-d01c-492f-bc80-00c1fcc3dca9 req-7af121df-c3a4-4e5d-af21-2f14bc1c64c0 service neutron] 10.222.0.61 "GET /v2.0/networks?id=f5a54297-6b64-4f71-b9f2-2f9c14a03187 HTTP/1.1" status: 200 len: 915 time: 0.0826867 Dec 08 11:38:17.962520 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cd649456-d01c-492f-bc80-00c1fcc3dca9 req-24a85e41-7c9a-450e-857d-6bf10c029e31 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec HTTP/1.1" status: 200 len: 1001 time: 0.0880082 Dec 08 11:38:17.974206 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20703ade-b06f-4047-aace-9a335afdd163 req-6d63e302-513f-4ce3-9a29-4b5011e18d0b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:17.976159 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20703ade-b06f-4047-aace-9a335afdd163 req-6d63e302-513f-4ce3-9a29-4b5011e18d0b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0948710 Dec 08 11:38:18.041213 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd649456-d01c-492f-bc80-00c1fcc3dca9 req-ab98013d-a453-4e73-afc6-7cb6a7a0942a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:18.042601 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cd649456-d01c-492f-bc80-00c1fcc3dca9 req-ab98013d-a453-4e73-afc6-7cb6a7a0942a service neutron] 10.222.0.61 "GET /v2.0/subnets?id=07f39602-a4ed-4df9-a6e2-9c0943b66135 HTTP/1.1" status: 200 len: 853 time: 0.0656168 Dec 08 11:38:18.062141 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20703ade-b06f-4047-aace-9a335afdd163 req-2b1b89ec-c0cd-478c-acb7-9782406dcd38 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0783098 Dec 08 11:38:18.098785 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd649456-d01c-492f-bc80-00c1fcc3dca9 req-23b8d171-e626-4290-8fe7-28e9bf61fd2b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:18.100328 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cd649456-d01c-492f-bc80-00c1fcc3dca9 req-23b8d171-e626-4290-8fe7-28e9bf61fd2b service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=f5a54297-6b64-4f71-b9f2-2f9c14a03187&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0495064 Dec 08 11:38:18.191608 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cd649456-d01c-492f-bc80-00c1fcc3dca9 req-649f482c-7848-442c-b0dd-43b78c006d78 service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837655 Dec 08 11:38:18.346135 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbfe0b6c-3bf0-4b83-8d95-913d7a39cbe4 req-cad0f5d5-cc6b-4d34-85e5-44a381134322 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:18.347590 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fbfe0b6c-3bf0-4b83-8d95-913d7a39cbe4 req-cad0f5d5-cc6b-4d34-85e5-44a381134322 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.1308804 Dec 08 11:38:18.353577 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cd649456-d01c-492f-bc80-00c1fcc3dca9 req-19612fe8-0312-42c1-a79e-6d2238d16fe2 service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1546793 Dec 08 11:38:18.357739 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 req-67285843-2992-47ce-aa4b-5f0d621fbe3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:18.359063 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 req-67285843-2992-47ce-aa4b-5f0d621fbe3d service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=9c60094b48d34489b46e92ae73d7e33a&device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 1098 time: 0.0828969 Dec 08 11:38:18.450291 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fbfe0b6c-3bf0-4b83-8d95-913d7a39cbe4 req-d8669f40-7bb7-42c3-8d49-853d9872d3df tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0958266 Dec 08 11:38:18.477176 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 req-01c6a839-92bf-4ebe-b489-9be8489dd634 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:18.478611 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 req-01c6a839-92bf-4ebe-b489-9be8489dd634 service neutron] 10.222.0.61 "GET /v2.0/networks?id=185aeb08-41ef-4fae-a420-33296f710850 HTTP/1.1" status: 200 len: 911 time: 0.1074908 Dec 08 11:38:18.546563 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 req-ec08a249-3dac-4927-886c-f54a1669bbd9 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=731fa8a4-e27d-4561-a86e-aa21c87548e7 HTTP/1.1" status: 200 len: 1001 time: 0.0598848 Dec 08 11:38:18.594343 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 req-a1511760-9aab-4888-9e91-a9e83979b55f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:18.595707 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 req-a1511760-9aab-4888-9e91-a9e83979b55f service neutron] 10.222.0.61 "GET /v2.0/subnets?id=40a584f7-ce77-4d89-87c2-4f3f589c6700 HTTP/1.1" status: 200 len: 849 time: 0.0414660 Dec 08 11:38:18.640729 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 req-103e1e09-7111-4425-b66e-3c6e97303b19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:18.642112 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 req-103e1e09-7111-4425-b66e-3c6e97303b19 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=185aeb08-41ef-4fae-a420-33296f710850&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0388379 Dec 08 11:38:18.741025 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 req-375c3862-e5b2-4038-bc09-d0580015f7ea service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864968 Dec 08 11:38:18.829553 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b0e98441-34e6-4a8a-b51b-f11e0a48dd97 req-d4393c5d-b578-40ed-be54-cfbf11ffb617 service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0800421 Dec 08 11:38:19.569661 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ca88ecd-5f76-4fee-b670-38e0615fe977 req-93c37835-3e7c-448f-a994-540df1211e9c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:19.571136 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1ca88ecd-5f76-4fee-b670-38e0615fe977 req-93c37835-3e7c-448f-a994-540df1211e9c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0516982 Dec 08 11:38:19.620615 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1ca88ecd-5f76-4fee-b670-38e0615fe977 req-9ded7ff1-fd91-4b96-aaa4-ede16326432f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431499 Dec 08 11:38:22.115099 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57186) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:22.220821 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d6e03bff-855a-4629-a996-718bff1c3e46 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.292591 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d6e03bff-855a-4629-a996-718bff1c3e46 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.296446 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d6e03bff-855a-4629-a996-718bff1c3e46 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.334000 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-d6e03bff-855a-4629-a996-718bff1c3e46 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=0cb8fc9cb2304971acd59b35fbedbc0a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2178457 Dec 08 11:38:22.335876 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e03bff-855a-4629-a996-718bff1c3e46 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d689478-ec72-422a-ae7a-31f3d21ea85e,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:22.336719 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57190) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:22.385310 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c4e96b45-e0b5-4870-8f79-b9ca4a74b318 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.406116 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c4e96b45-e0b5-4870-8f79-b9ca4a74b318 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.452107 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c4e96b45-e0b5-4870-8f79-b9ca4a74b318 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.454743 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c4e96b45-e0b5-4870-8f79-b9ca4a74b318 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.458302 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-c4e96b45-e0b5-4870-8f79-b9ca4a74b318 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/6d689478-ec72-422a-ae7a-31f3d21ea85e HTTP/1.1" status: 204 len: 168 time: 0.1180663 Dec 08 11:38:22.465353 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-af34c4d4-f08b-4502-a4ea-b20152034ef5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.465842 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4e96b45-e0b5-4870-8f79-b9ca4a74b318 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d689478-ec72-422a-ae7a-31f3d21ea85e,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:22.716966 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57198) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:22.733005 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7e18e4aa-2f7b-4f3c-8d57-862fe1de38a1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.805963 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7e18e4aa-2f7b-4f3c-8d57-862fe1de38a1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.809516 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7e18e4aa-2f7b-4f3c-8d57-862fe1de38a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.847013 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-7e18e4aa-2f7b-4f3c-8d57-862fe1de38a1 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=85637acabb8343fd9671680a2e4e81d2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1286786 Dec 08 11:38:22.847865 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e18e4aa-2f7b-4f3c-8d57-862fe1de38a1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1fb9a145-1bbe-4df9-8f07-50dbe2519715,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:22.849844 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57200) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:22.896651 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-de9b6c2b-5a96-4cdf-82cc-9a647cc63092 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.917827 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-de9b6c2b-5a96-4cdf-82cc-9a647cc63092 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.963051 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-de9b6c2b-5a96-4cdf-82cc-9a647cc63092 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.965624 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-de9b6c2b-5a96-4cdf-82cc-9a647cc63092 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:22.966774 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-de9b6c2b-5a96-4cdf-82cc-9a647cc63092 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/1fb9a145-1bbe-4df9-8f07-50dbe2519715 HTTP/1.1" status: 204 len: 168 time: 0.1159427 Dec 08 11:38:22.974205 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de9b6c2b-5a96-4cdf-82cc-9a647cc63092 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1fb9a145-1bbe-4df9-8f07-50dbe2519715,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:24.693547 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-8c93d143-ba03-4a9a-9520-b70aa8421ea6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:25.635047 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57334) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:25.738353 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1d93c24f-5103-4898-9c39-f11966e4cbcb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:25.787860 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:25.818093 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1d93c24f-5103-4898-9c39-f11966e4cbcb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:25.822277 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1d93c24f-5103-4898-9c39-f11966e4cbcb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:25.860546 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-1d93c24f-5103-4898-9c39-f11966e4cbcb admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=e7ff130d888949b6ab2a0113f812c098&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2243996 Dec 08 11:38:25.861307 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d93c24f-5103-4898-9c39-f11966e4cbcb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ced97310-8692-4a74-afb0-e087a8ccf0a3,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:25.863910 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57340) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:25.912899 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6d6113a9-d48b-4418-87ce-adc00e50e3ca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:25.933894 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6d6113a9-d48b-4418-87ce-adc00e50e3ca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:25.978310 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6d6113a9-d48b-4418-87ce-adc00e50e3ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:25.980904 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6d6113a9-d48b-4418-87ce-adc00e50e3ca admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:25.982070 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-6d6113a9-d48b-4418-87ce-adc00e50e3ca admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/ced97310-8692-4a74-afb0-e087a8ccf0a3 HTTP/1.1" status: 204 len: 168 time: 0.1171160 Dec 08 11:38:25.989735 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d6113a9-d48b-4418-87ce-adc00e50e3ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ced97310-8692-4a74-afb0-e087a8ccf0a3,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:26.234823 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57346) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:26.248159 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cc630123-a2ab-4adc-8cfa-de8e3644d78f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:26.325057 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cc630123-a2ab-4adc-8cfa-de8e3644d78f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:26.332119 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-cc630123-a2ab-4adc-8cfa-de8e3644d78f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:26.371478 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-cc630123-a2ab-4adc-8cfa-de8e3644d78f admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=eed0360283854741a18b0f9749d5f9a0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1355722 Dec 08 11:38:26.372877 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc630123-a2ab-4adc-8cfa-de8e3644d78f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=72b5a392-6160-4f91-a8e6-135b25860d3c,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:26.374170 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57348) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:26.422881 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-19d71e28-b55d-43ce-bfff-5dd1133498ad admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:26.444857 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-19d71e28-b55d-43ce-bfff-5dd1133498ad admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:26.491225 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-19d71e28-b55d-43ce-bfff-5dd1133498ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:26.494421 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-19d71e28-b55d-43ce-bfff-5dd1133498ad admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:26.495656 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-19d71e28-b55d-43ce-bfff-5dd1133498ad admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/72b5a392-6160-4f91-a8e6-135b25860d3c HTTP/1.1" status: 204 len: 168 time: 0.1204419 Dec 08 11:38:26.503889 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19d71e28-b55d-43ce-bfff-5dd1133498ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72b5a392-6160-4f91-a8e6-135b25860d3c,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:26.913680 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 req-db5a4b1b-4ae6-4048-8a62-3c49c482148f tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-2138933485&fields=id&tenant_id=3102b9c0f7ea45048750ae3c81085631 HTTP/1.1" status: 200 len: 267 time: 0.0480132 Dec 08 11:38:26.971115 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 req-6144ce01-7ced-46b4-9d52-9765ca6f2b27 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:26.972722 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 req-6144ce01-7ced-46b4-9d52-9765ca6f2b27 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 985 time: 0.0525355 Dec 08 11:38:26.984261 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 req-d936b9c9-319b-4b5a-9d30-6f5a0385f7f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Request body: {'port': {'security_groups': ['18816c08-841a-4a06-aa5d-1bb76e44c9f4']}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:38:27.064212 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 req-d936b9c9-319b-4b5a-9d30-6f5a0385f7f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:27.148971 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:27.245599 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 req-d936b9c9-319b-4b5a-9d30-6f5a0385f7f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] For port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:38:27.275434 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 req-d936b9c9-319b-4b5a-9d30-6f5a0385f7f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:27.279979 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 req-d936b9c9-319b-4b5a-9d30-6f5a0385f7f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:27.293718 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['7fe8b63d-f6cd-45dc-a53c-93b64cacfeec'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:38:27.328978 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 req-d936b9c9-319b-4b5a-9d30-6f5a0385f7f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:27.329788 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 req-d936b9c9-319b-4b5a-9d30-6f5a0385f7f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:27.334417 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6d69c077-37ff-4fbd-ba12-e91b37c8ff45 req-d936b9c9-319b-4b5a-9d30-6f5a0385f7f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "PUT /v2.0/ports/7fe8b63d-f6cd-45dc-a53c-93b64cacfeec HTTP/1.1" status: 200 len: 943 time: 0.3544924 Dec 08 11:38:27.334972 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:38:27.337868 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57378) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:27.346759 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-180352f3-8678-4a77-81d3-861e98719559" -d '{"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:38:27.404468 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d936b9c9-319b-4b5a-9d30-6f5a0385f7f5 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event updated for resources: {'Port': ['ID=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,revision_number=7']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:27.430431 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0ecd80de-24c5-4e65-b5f3-d8fb9b9d1207 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:27.432816 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:38:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-becbe910-d017-4078-a520-629a3bb2295f x-openstack-request-id: req-becbe910-d017-4078-a520-629a3bb2295f {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:38:27.433115 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:38:27.433657 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-becbe910-d017-4078-a520-629a3bb2295f {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:38:27.433799 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec', 'status': 'completed', 'code': 200} Dec 08 11:38:27.435709 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['7fe8b63d-f6cd-45dc-a53c-93b64cacfeec'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:38:27.466036 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0ecd80de-24c5-4e65-b5f3-d8fb9b9d1207 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:27.498500 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-180352f3-8678-4a77-81d3-861e98719559 req-534eb889-f427-4f3b-a843-dfa5e9cfc860 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:27.500036 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-180352f3-8678-4a77-81d3-861e98719559 req-534eb889-f427-4f3b-a843-dfa5e9cfc860 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=3102b9c0f7ea45048750ae3c81085631&device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 1099 time: 0.0615926 Dec 08 11:38:27.551370 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0ecd80de-24c5-4e65-b5f3-d8fb9b9d1207 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:27.555081 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0ecd80de-24c5-4e65-b5f3-d8fb9b9d1207 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:27.557967 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-0ecd80de-24c5-4e65-b5f3-d8fb9b9d1207 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "DELETE /v2.0/security-groups/7c872497-d719-4618-a000-bf3059a98a01 HTTP/1.1" status: 204 len: 168 time: 0.2189949 Dec 08 11:38:27.563953 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57386) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:27.569408 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ecd80de-24c5-4e65-b5f3-d8fb9b9d1207 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7c872497-d719-4618-a000-bf3059a98a01,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:27.704720 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-afa2a3bc-871b-4052-8cad-df93551829bc None None] Provisioning complete for port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:38:27.705117 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-afa2a3bc-871b-4052-8cad-df93551829bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:27.970139 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-180352f3-8678-4a77-81d3-861e98719559 req-be46edb5-21b5-4136-9c9e-d46a2d088576 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:27.971559 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-180352f3-8678-4a77-81d3-861e98719559 req-be46edb5-21b5-4136-9c9e-d46a2d088576 service neutron] 10.222.0.61 "GET /v2.0/networks?id=f5a54297-6b64-4f71-b9f2-2f9c14a03187 HTTP/1.1" status: 200 len: 915 time: 0.4606514 Dec 08 11:38:28.064530 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-180352f3-8678-4a77-81d3-861e98719559 req-2dd1f119-42e6-4fd7-a04c-422806a060df service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec HTTP/1.1" status: 200 len: 1001 time: 0.0845554 Dec 08 11:38:28.107117 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-0f54a9ef-4326-4ef3-aa83-a1beea912267 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Deleting port c7ff33e6-1ad6-4d1e-933b-b68e4261449c {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:38:28.111989 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0f54a9ef-4326-4ef3-aa83-a1beea912267 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:28.163166 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-180352f3-8678-4a77-81d3-861e98719559 req-2c7bb2a5-debc-474c-b802-14098458e567 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:28.163399 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:28.165179 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-180352f3-8678-4a77-81d3-861e98719559 req-2c7bb2a5-debc-474c-b802-14098458e567 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=07f39602-a4ed-4df9-a6e2-9c0943b66135 HTTP/1.1" status: 200 len: 853 time: 0.0908923 Dec 08 11:38:28.222949 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0f54a9ef-4326-4ef3-aa83-a1beea912267 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:28.223271 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0f54a9ef-4326-4ef3-aa83-a1beea912267 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:28.240491 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-0f54a9ef-4326-4ef3-aa83-a1beea912267 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling delete_port for c7ff33e6-1ad6-4d1e-933b-b68e4261449c owned by network:floatingip {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:38:28.243407 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-180352f3-8678-4a77-81d3-861e98719559 req-71305f03-7988-4214-adea-9f0c199173b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:28.244864 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-180352f3-8678-4a77-81d3-861e98719559 req-71305f03-7988-4214-adea-9f0c199173b8 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=f5a54297-6b64-4f71-b9f2-2f9c14a03187&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0699451 Dec 08 11:38:28.430749 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-180352f3-8678-4a77-81d3-861e98719559 req-1dae1205-8996-42ba-8738-3761d0c523e4 service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1761570 Dec 08 11:38:28.559411 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0f54a9ef-4326-4ef3-aa83-a1beea912267 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:28.595355 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f54a9ef-4326-4ef3-aa83-a1beea912267 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event deleted for resources: {'Port': ['ID=c7ff33e6-1ad6-4d1e-933b-b68e4261449c,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:28.620363 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-180352f3-8678-4a77-81d3-861e98719559 req-27ca3357-eb74-4bda-9489-52c88aefd485 service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1795869 Dec 08 11:38:28.656584 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0f54a9ef-4326-4ef3-aa83-a1beea912267 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks [] for floatingip, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:28.656911 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [None req-0f54a9ef-4326-4ef3-aa83-a1beea912267 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Floating IP df61cd37-6d91-4fdf-bee1-dfc7294f2b53 disassociated (deleted). External IP: 172.27.2.87, port: 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec. Dec 08 11:38:28.859943 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f54a9ef-4326-4ef3-aa83-a1beea912267 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:38:28.964771 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f54a9ef-4326-4ef3-aa83-a1beea912267 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:38:28.969856 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0f54a9ef-4326-4ef3-aa83-a1beea912267 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:28.974072 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d918624f-f37a-4175-ba66-edcceb568fd6 None None] Sync routers for ids ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:38:28.984440 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d918624f-f37a-4175-ba66-edcceb568fd6 None None] Routers {'c3589b0b-43e0-46da-93f9-ec8e7a1164a6'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:38:28.985135 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d918624f-f37a-4175-ba66-edcceb568fd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:38:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:28.997446 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-0f54a9ef-4326-4ef3-aa83-a1beea912267 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "DELETE /v2.0/floatingips/df61cd37-6d91-4fdf-bee1-dfc7294f2b53 HTTP/1.1" status: 204 len: 168 time: 1.4309764 Dec 08 11:38:29.091866 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-d918624f-f37a-4175-ba66-edcceb568fd6 None None] Set router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:38:29.307350 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d918624f-f37a-4175-ba66-edcceb568fd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86'}], 'enable_snat': True}, 'gw_port_id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:14Z', 'revision_number': 4, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port': {'id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:50:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 278, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '00496e9d-a438-4edc-b803-98d3f6b8e626', 'name': '', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'mac_address': 'fa:16:3e:37:98:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 279, 'fixed_ips': [{'subnet_id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:14Z', 'updated_at': '2021-12-08T11:32:19Z', 'revision_number': 5, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'subnets': [{'id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:29.335272 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d918624f-f37a-4175-ba66-edcceb568fd6 None None] Checking router: c3589b0b-43e0-46da-93f9-ec8e7a1164a6 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:38:29.344080 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d918624f-f37a-4175-ba66-edcceb568fd6 None None] Routers {'c3589b0b-43e0-46da-93f9-ec8e7a1164a6'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:38:29.344683 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d918624f-f37a-4175-ba66-edcceb568fd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:38:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:29.434530 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:38:29.436799 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ed9377c2-ea52-45aa-a755-d316380be933" -d '{"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:38:29.446372 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-d918624f-f37a-4175-ba66-edcceb568fd6 None None] Set router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:38:29.472471 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:38:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2c9db5bc-3b95-4540-9e98-0f4b4e1e5cab x-openstack-request-id: req-2c9db5bc-3b95-4540-9e98-0f4b4e1e5cab {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:38:29.472771 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:38:29.473032 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-2c9db5bc-3b95-4540-9e98-0f4b4e1e5cab {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:38:29.473460 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec', 'status': 'completed', 'code': 200} Dec 08 11:38:29.539123 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed9377c2-ea52-45aa-a755-d316380be933 req-3c533ef3-7264-492d-80c1-a88b76a49110 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:29.540753 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ed9377c2-ea52-45aa-a755-d316380be933 req-3c533ef3-7264-492d-80c1-a88b76a49110 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=3102b9c0f7ea45048750ae3c81085631&device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 1099 time: 0.0428097 Dec 08 11:38:29.646904 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed9377c2-ea52-45aa-a755-d316380be933 req-536eca83-9a6b-48fb-ba98-b210cc3cca33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:29.648477 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ed9377c2-ea52-45aa-a755-d316380be933 req-536eca83-9a6b-48fb-ba98-b210cc3cca33 service neutron] 10.222.0.61 "GET /v2.0/networks?id=f5a54297-6b64-4f71-b9f2-2f9c14a03187 HTTP/1.1" status: 200 len: 915 time: 0.0980406 Dec 08 11:38:29.653065 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d918624f-f37a-4175-ba66-edcceb568fd6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86'}], 'enable_snat': True}, 'gw_port_id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:14Z', 'revision_number': 4, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port': {'id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:50:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 278, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '00496e9d-a438-4edc-b803-98d3f6b8e626', 'name': '', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'mac_address': 'fa:16:3e:37:98:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 279, 'fixed_ips': [{'subnet_id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:14Z', 'updated_at': '2021-12-08T11:32:19Z', 'revision_number': 5, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'subnets': [{'id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:29.692251 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d918624f-f37a-4175-ba66-edcceb568fd6 None None] The sync data for ids ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'] in dv-cinder-819778-3-iscsi is: [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86'}], 'enable_snat': True}, 'gw_port_id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:14Z', 'revision_number': 4, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port': {'id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:50:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 278, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '00496e9d-a438-4edc-b803-98d3f6b8e626', 'name': '', 'network_id': 'f5a54297-6b64-4f71-b9f2-2f9c14a03187', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'mac_address': 'fa:16:3e:37:98:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_interface', 'standard_attr_id': 279, 'fixed_ips': [{'subnet_id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:14Z', 'updated_at': '2021-12-08T11:32:19Z', 'revision_number': 5, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'subnets': [{'id': '07f39602-a4ed-4df9-a6e2-9c0943b66135', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:38:29.705731 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ed9377c2-ea52-45aa-a755-d316380be933 req-b02777be-228a-4f2b-9e48-73029f3e2a88 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec HTTP/1.1" status: 200 len: 217 time: 0.0444064 Dec 08 11:38:29.783269 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed9377c2-ea52-45aa-a755-d316380be933 req-473b319c-8302-4969-809c-3af8004c31a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:29.784792 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ed9377c2-ea52-45aa-a755-d316380be933 req-473b319c-8302-4969-809c-3af8004c31a8 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=07f39602-a4ed-4df9-a6e2-9c0943b66135 HTTP/1.1" status: 200 len: 853 time: 0.0552111 Dec 08 11:38:29.843283 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed9377c2-ea52-45aa-a755-d316380be933 req-9e724d89-346f-40b3-a776-1f9b54e889d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:29.844792 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ed9377c2-ea52-45aa-a755-d316380be933 req-9e724d89-346f-40b3-a776-1f9b54e889d6 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=f5a54297-6b64-4f71-b9f2-2f9c14a03187&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0422018 Dec 08 11:38:29.893264 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:38:29.929979 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8fe914c-b76b-405e-950c-d3c977e70985 None None] New status for floating IP df61cd37-6d91-4fdf-bee1-dfc7294f2b53: DOWN {{(pid=102320) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:38:29.943416 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ed9377c2-ea52-45aa-a755-d316380be933 req-900acf94-8e94-4192-9031-1b44e743dfc2 service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839193 Dec 08 11:38:30.036915 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ed9377c2-ea52-45aa-a755-d316380be933 req-2d5db8f0-bbe3-488b-8e91-df111937440e service neutron] 10.222.0.61 "GET /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859797 Dec 08 11:38:35.885978 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97d99a1f-f21f-40f4-a756-f0e2ca4b6ff9 req-ed8a9446-bf4d-4af0-90b6-2b4b8269cd67 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:35.887328 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-97d99a1f-f21f-40f4-a756-f0e2ca4b6ff9 req-ed8a9446-bf4d-4af0-90b6-2b4b8269cd67 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 946 time: 0.0479891 Dec 08 11:38:35.933511 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-97d99a1f-f21f-40f4-a756-f0e2ca4b6ff9 req-4cdeae9a-3874-4a4c-9c1e-f7bcb734c8de tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396838 Dec 08 11:38:36.334376 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-900fbb4f-0dcd-4d6d-a637-0e7afa2a287c req-5b9b1c53-269c-4fc4-903a-756772908078 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:36.344553 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-900fbb4f-0dcd-4d6d-a637-0e7afa2a287c req-5b9b1c53-269c-4fc4-903a-756772908078 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.0493200 Dec 08 11:38:36.395643 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-900fbb4f-0dcd-4d6d-a637-0e7afa2a287c req-a4c1fb7c-6c8c-4aa8-8864-1fc88aa073bd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486925 Dec 08 11:38:37.002649 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4517de2-c682-4b20-8fba-0f184cb0808e req-ca5209c8-1736-4de8-a986-657d34281673 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:37.004087 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4517de2-c682-4b20-8fba-0f184cb0808e req-ca5209c8-1736-4de8-a986-657d34281673 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.61 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 946 time: 0.0469284 Dec 08 11:38:37.107408 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78aaaf6b-c505-4ade-95a9-d030ce8c1135 req-26bef634-a4d9-43b8-8613-e96431bb4bd0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:37.109141 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-78aaaf6b-c505-4ade-95a9-d030ce8c1135 req-26bef634-a4d9-43b8-8613-e96431bb4bd0 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/ports?device_id=c83efb85-fcf2-457d-9941-03898d0dccfd HTTP/1.1" status: 200 len: 946 time: 0.1041975 Dec 08 11:38:37.163159 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-c4517de2-c682-4b20-8fba-0f184cb0808e req-0a9fbe2f-1c2a-47fb-b168-f2d86d7e85f8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Deleting port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:38:37.163518 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c4517de2-c682-4b20-8fba-0f184cb0808e req-0a9fbe2f-1c2a-47fb-b168-f2d86d7e85f8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:37.182312 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-78aaaf6b-c505-4ade-95a9-d030ce8c1135 req-cce7ebc3-2c6d-46bb-89a2-f7665cb8e8ae tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.66 "GET /v2.0/security-groups?id=18816c08-841a-4a06-aa5d-1bb76e44c9f4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658429 Dec 08 11:38:37.254812 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-c4517de2-c682-4b20-8fba-0f184cb0808e req-0a9fbe2f-1c2a-47fb-b168-f2d86d7e85f8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] For port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:38:37.255089 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c4517de2-c682-4b20-8fba-0f184cb0808e req-0a9fbe2f-1c2a-47fb-b168-f2d86d7e85f8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:37.271387 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-c4517de2-c682-4b20-8fba-0f184cb0808e req-0a9fbe2f-1c2a-47fb-b168-f2d86d7e85f8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Calling delete_port for 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:38:37.394728 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c4517de2-c682-4b20-8fba-0f184cb0808e req-0a9fbe2f-1c2a-47fb-b168-f2d86d7e85f8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:37.411815 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['7fe8b63d-f6cd-45dc-a53c-93b64cacfeec'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:38:37.425754 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a9fbe2f-1c2a-47fb-b168-f2d86d7e85f8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Pushing event deleted for resources: {'Port': ['ID=7fe8b63d-f6cd-45dc-a53c-93b64cacfeec,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:37.476515 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-c4517de2-c682-4b20-8fba-0f184cb0808e req-0a9fbe2f-1c2a-47fb-b168-f2d86d7e85f8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] No DVR routers for this DVR port 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:38:37.479652 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c4517de2-c682-4b20-8fba-0f184cb0808e req-0a9fbe2f-1c2a-47fb-b168-f2d86d7e85f8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:37.483358 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4517de2-c682-4b20-8fba-0f184cb0808e req-0a9fbe2f-1c2a-47fb-b168-f2d86d7e85f8 tempest-TestMinimumBasicScenario-1746862656 tempest-TestMinimumBasicScenario-1746862656-project] 10.222.0.61 "DELETE /v2.0/ports/7fe8b63d-f6cd-45dc-a53c-93b64cacfeec HTTP/1.1" status: 204 len: 173 time: 0.4685276 Dec 08 11:38:37.483889 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'name': 'network-vif-deleted', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:38:37.486353 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7d77ba58-c7ac-49fa-a1a0-19974a0dc810" -d '{"events": [{"server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "name": "network-vif-deleted", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:38:37.541747 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3e3305d-5000-4bdf-9af0-c6e4675937b8 req-ef45b3ef-fb1e-4330-bcfc-e3a91c00d729 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:37.543496 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e3e3305d-5000-4bdf-9af0-c6e4675937b8 req-ef45b3ef-fb1e-4330-bcfc-e3a91c00d729 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.0538125 Dec 08 11:38:37.545237 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:38:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aac1aab7-1dc5-4876-b7a4-7cdeefe8a39b x-openstack-request-id: req-aac1aab7-1dc5-4876-b7a4-7cdeefe8a39b {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:38:37.545621 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c83efb85-fcf2-457d-9941-03898d0dccfd", "name": "network-vif-deleted", "tag": "7fe8b63d-f6cd-45dc-a53c-93b64cacfeec", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:38:37.546615 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-aac1aab7-1dc5-4876-b7a4-7cdeefe8a39b {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:38:37.547077 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c83efb85-fcf2-457d-9941-03898d0dccfd', 'name': 'network-vif-deleted', 'tag': '7fe8b63d-f6cd-45dc-a53c-93b64cacfeec', 'status': 'completed', 'code': 200} Dec 08 11:38:37.608039 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e3e3305d-5000-4bdf-9af0-c6e4675937b8 req-c32c17c2-78e7-4edf-8507-86599efbf4d8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458992 Dec 08 11:38:37.802717 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57512) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:37.910468 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7ee9348e-2733-4753-bf3a-d4e9266a8865 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:37.999095 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7ee9348e-2733-4753-bf3a-d4e9266a8865 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:38.003207 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7ee9348e-2733-4753-bf3a-d4e9266a8865 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:38.043588 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ee9348e-2733-4753-bf3a-d4e9266a8865 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f329c3f-11bf-4908-99d5-49342ceaadea,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:38.047757 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-7ee9348e-2733-4753-bf3a-d4e9266a8865 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=2cfb456a5d364281ac7269934f5daa15&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2440147 Dec 08 11:38:38.050639 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57518) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:38.109738 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c4c4a079-f292-4f42-ab43-e85c842d316a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:38.130666 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c4c4a079-f292-4f42-ab43-e85c842d316a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:38.177298 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c4c4a079-f292-4f42-ab43-e85c842d316a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:38.180070 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c4c4a079-f292-4f42-ab43-e85c842d316a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:38.181261 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-c4c4a079-f292-4f42-ab43-e85c842d316a admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/1f329c3f-11bf-4908-99d5-49342ceaadea HTTP/1.1" status: 204 len: 168 time: 0.1297891 Dec 08 11:38:38.190003 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4c4a079-f292-4f42-ab43-e85c842d316a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f329c3f-11bf-4908-99d5-49342ceaadea,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:38.277457 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-10ae7b31-4cb4-475f-b65c-e37b89115961 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:38.280559 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-10ae7b31-4cb4-475f-b65c-e37b89115961 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.61 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.0677700 Dec 08 11:38:38.391787 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Deleting port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:38:38.392965 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:38.491415 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57546) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:38.515310 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-279d53af-9d64-4e97-aa1e-215476cf11a0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:38.538089 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] For port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:38:38.538485 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:38.816521 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-279d53af-9d64-4e97-aa1e-215476cf11a0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:38.828047 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-279d53af-9d64-4e97-aa1e-215476cf11a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:38.846022 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25f1c725-75f0-4774-9071-b1b911430ead req-f900c1d1-ad8a-42e5-9296-df6285b68a87 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:38.847525 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-25f1c725-75f0-4774-9071-b1b911430ead req-f900c1d1-ad8a-42e5-9296-df6285b68a87 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 947 time: 0.1397238 Dec 08 11:38:38.904550 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:38.904911 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:38.905289 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Floating IP 07f6101c-247e-4ed1-a7fa-bfb3e71fdaa3 disassociated. External IP: 172.27.2.95, port: 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe. Dec 08 11:38:38.905599 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling delete_port for 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:38:38.917923 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-279d53af-9d64-4e97-aa1e-215476cf11a0 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=138d2b4ff3ab4f4d9006138db413f691&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4220886 Dec 08 11:38:38.918797 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57572) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:38.930572 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-279d53af-9d64-4e97-aa1e-215476cf11a0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3c0306c-293d-4d48-8ae0-269d9758a4f1,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:39.017065 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-25f1c725-75f0-4774-9071-b1b911430ead req-3e09ed51-2913-45d3-9821-2c2059217cdc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=4bc81893-96c8-4fe5-ac25-8ff352618e25&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1583769 Dec 08 11:38:39.050104 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b19bd142-0b50-487f-a1cb-7fd0222a35c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:39.084988 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b19bd142-0b50-487f-a1cb-7fd0222a35c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:39.160299 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57578) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:39.163824 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:39.197394 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b19bd142-0b50-487f-a1cb-7fd0222a35c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:39.199943 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b19bd142-0b50-487f-a1cb-7fd0222a35c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:39.203615 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-b19bd142-0b50-487f-a1cb-7fd0222a35c8 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/b3c0306c-293d-4d48-8ae0-269d9758a4f1 HTTP/1.1" status: 204 len: 168 time: 0.2811611 Dec 08 11:38:39.209035 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event deleted for resources: {'Port': ['ID=2ebdbac7-6fba-4bd2-bbec-7e49216db3fe,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:39.219931 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b19bd142-0b50-487f-a1cb-7fd0222a35c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3c0306c-293d-4d48-8ae0-269d9758a4f1,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:39.615640 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:38:39.743256 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:38:39.754121 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1368faf-8170-4cd9-a3c4-b9feebbada45 None None] Sync routers for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:38:39.768385 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1368faf-8170-4cd9-a3c4-b9feebbada45 None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:38:39.776009 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-f1368faf-8170-4cd9-a3c4-b9feebbada45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:38:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:39.822643 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] No DVR routers for this DVR port 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:38:39.826996 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:39.831168 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-48286d32-42cb-4691-8b9a-65fbe5b5d25a req-a504d71f-1b09-4615-a61c-a59f854b36b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.61 "DELETE /v2.0/ports/2ebdbac7-6fba-4bd2-bbec-7e49216db3fe HTTP/1.1" status: 204 len: 173 time: 1.5435560 Dec 08 11:38:39.831866 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'name': 'network-vif-deleted', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:38:39.835372 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-73290c0b-cc2b-4274-a7b4-643d3520de12" -d '{"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-deleted", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:38:39.842349 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-488b2610-84ab-494b-ac3c-d3e290d100d5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7897011'] for router_interface, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:39.878081 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:38:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-56c5aca4-f9c5-4781-9bf6-7574a9d24eb1 x-openstack-request-id: req-56c5aca4-f9c5-4781-9bf6-7574a9d24eb1 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:38:39.878391 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f", "name": "network-vif-deleted", "tag": "2ebdbac7-6fba-4bd2-bbec-7e49216db3fe", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:38:39.878688 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-56c5aca4-f9c5-4781-9bf6-7574a9d24eb1 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:38:39.879107 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f', 'name': 'network-vif-deleted', 'tag': '2ebdbac7-6fba-4bd2-bbec-7e49216db3fe', 'status': 'completed', 'code': 200} Dec 08 11:38:39.980247 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-f1368faf-8170-4cd9-a3c4-b9feebbada45 None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:38:40.195455 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b4bb46c2-b684-40f4-8425-ccbaa1a8c3ed req-c6576e4b-d87d-476a-abdd-d82d77d680ae tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=2e591fa7-b5c1-4a7f-a6ed-9a13fd2f965f HTTP/1.1" status: 200 len: 210 time: 0.0364273 Dec 08 11:38:40.243571 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-488b2610-84ab-494b-ac3c-d3e290d100d5 admin admin] Deleting port 00496e9d-a438-4edc-b803-98d3f6b8e626 {{(pid=102317) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:38:40.244494 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-488b2610-84ab-494b-ac3c-d3e290d100d5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:40.344550 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [None req-488b2610-84ab-494b-ac3c-d3e290d100d5 admin admin] For port 00496e9d-a438-4edc-b803-98d3f6b8e626, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=00496e9d-a438-4edc-b803-98d3f6b8e626,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102317) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:38:40.344934 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-488b2610-84ab-494b-ac3c-d3e290d100d5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:40.364203 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-488b2610-84ab-494b-ac3c-d3e290d100d5 admin admin] Calling delete_port for 00496e9d-a438-4edc-b803-98d3f6b8e626 owned by network:router_interface {{(pid=102317) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:38:40.471387 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-f1368faf-8170-4cd9-a3c4-b9feebbada45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:27Z', 'revision_number': 5, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:40.506244 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1368faf-8170-4cd9-a3c4-b9feebbada45 None None] Checking router: d1e1bffc-ba94-4ef3-b10a-203d4ed7519f for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:38:40.514937 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1368faf-8170-4cd9-a3c4-b9feebbada45 None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:38:40.515540 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-f1368faf-8170-4cd9-a3c4-b9feebbada45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:38:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:40.625601 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-488b2610-84ab-494b-ac3c-d3e290d100d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:40.633040 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-f1368faf-8170-4cd9-a3c4-b9feebbada45 None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:38:40.661222 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-488b2610-84ab-494b-ac3c-d3e290d100d5 admin admin] Pushing event deleted for resources: {'Port': ['ID=00496e9d-a438-4edc-b803-98d3f6b8e626,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:40.825648 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-488b2610-84ab-494b-ac3c-d3e290d100d5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8074906', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7896871'] for router_interface, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:40.903257 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-f1368faf-8170-4cd9-a3c4-b9feebbada45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:27Z', 'revision_number': 5, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:40.932284 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1368faf-8170-4cd9-a3c4-b9feebbada45 None None] The sync data for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi is: [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:27Z', 'revision_number': 5, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:38:40.961560 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:38:40.988484 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:38:40.989308 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 7fe8b63d-f6cd-45dc-a53c-93b64cacfeec not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:38:41.324964 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57640) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:41.339649 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2e47918d-62aa-43b6-aa03-70b0ebe663f8 None None] New status for floating IP 07f6101c-247e-4ed1-a7fa-bfb3e71fdaa3: DOWN {{(pid=102320) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:38:41.361499 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-488b2610-84ab-494b-ac3c-d3e290d100d5 admin admin] Router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:38:41.423521 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9f147d13-61d4-4485-a36e-2fbcc71ca169 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:41.461865 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9f147d13-61d4-4485-a36e-2fbcc71ca169 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:41.483593 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-488b2610-84ab-494b-ac3c-d3e290d100d5 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:38:41.489932 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-488b2610-84ab-494b-ac3c-d3e290d100d5 admin admin] 10.222.0.66 "PUT /v2.0/routers/c3589b0b-43e0-46da-93f9-ec8e7a1164a6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3278580 Dec 08 11:38:41.492492 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57650) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:41.495782 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65747e77-3b30-4b44-9f0f-21c1734ee051 None None] Sync routers for ids ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:38:41.512302 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65747e77-3b30-4b44-9f0f-21c1734ee051 None None] Routers {'c3589b0b-43e0-46da-93f9-ec8e7a1164a6'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:38:41.513244 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-65747e77-3b30-4b44-9f0f-21c1734ee051 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:38:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:41.545996 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9f147d13-61d4-4485-a36e-2fbcc71ca169 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:41.549062 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9f147d13-61d4-4485-a36e-2fbcc71ca169 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:41.550203 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-9f147d13-61d4-4485-a36e-2fbcc71ca169 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "DELETE /v2.0/security-groups/4bc81893-96c8-4fe5-ac25-8ff352618e25 HTTP/1.1" status: 204 len: 168 time: 0.2237661 Dec 08 11:38:41.552952 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57656) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:41.575333 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f147d13-61d4-4485-a36e-2fbcc71ca169 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bc81893-96c8-4fe5-ac25-8ff352618e25,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:41.584176 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.api.v2.resource [None req-cbe396dd-54a8-4e6b-9cad-03688789829e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] show failed (client error): The resource could not be found. Dec 08 11:38:41.586361 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-cbe396dd-54a8-4e6b-9cad-03688789829e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups/4bc81893-96c8-4fe5-ac25-8ff352618e25 HTTP/1.1" status: 404 len: 347 time: 0.0176899 Dec 08 11:38:41.589184 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57658) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:41.617526 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Publish callbacks [] for router, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:41.657884 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-65747e77-3b30-4b44-9f0f-21c1734ee051 None None] Set router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:38:41.737071 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-f1777098-58f2-4313-ba8e-b0530030a7ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Deleting port 94e4067d-f16a-47b3-9d16-44b3d772c1b4 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:38:41.737586 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f1777098-58f2-4313-ba8e-b0530030a7ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:41.737787 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:41.805625 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Deleting port daeaa3c9-fb8a-43b5-b80f-6094f617715e {{(pid=102317) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:38:41.805873 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:41.831641 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f1777098-58f2-4313-ba8e-b0530030a7ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:41.832113 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f1777098-58f2-4313-ba8e-b0530030a7ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:41.845294 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-f1777098-58f2-4313-ba8e-b0530030a7ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling delete_port for 94e4067d-f16a-47b3-9d16-44b3d772c1b4 owned by network:floatingip {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:38:41.860766 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-65747e77-3b30-4b44-9f0f-21c1734ee051 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86'}], 'enable_snat': True}, 'gw_port_id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:38:40Z', 'revision_number': 5, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port': {'id': 'daeaa3c9-fb8a-43b5-b80f-6094f617715e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:9b:50:b3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 278, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.86', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:32:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:41.889168 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65747e77-3b30-4b44-9f0f-21c1734ee051 None None] Checking router: c3589b0b-43e0-46da-93f9-ec8e7a1164a6 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:38:41.899211 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65747e77-3b30-4b44-9f0f-21c1734ee051 None None] Routers {'c3589b0b-43e0-46da-93f9-ec8e7a1164a6'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:38:41.900313 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-65747e77-3b30-4b44-9f0f-21c1734ee051 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:38:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:41.910106 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] For port daeaa3c9-fb8a-43b5-b80f-6094f617715e, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=daeaa3c9-fb8a-43b5-b80f-6094f617715e,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102317) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:38:41.910603 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:41.924385 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Calling delete_port for daeaa3c9-fb8a-43b5-b80f-6094f617715e owned by network:router_gateway {{(pid=102317) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:38:41.999023 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-65747e77-3b30-4b44-9f0f-21c1734ee051 None None] Set router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 gateway port host: None {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:38:42.011840 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f1777098-58f2-4313-ba8e-b0530030a7ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.041938 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57666) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:42.050150 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1777098-58f2-4313-ba8e-b0530030a7ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event deleted for resources: {'Port': ['ID=94e4067d-f16a-47b3-9d16-44b3d772c1b4,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:42.059624 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-65747e77-3b30-4b44-9f0f-21c1734ee051 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:38:41Z', 'revision_number': 6, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port_host': None}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:42.095589 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65747e77-3b30-4b44-9f0f-21c1734ee051 None None] The sync data for ids ['c3589b0b-43e0-46da-93f9-ec8e7a1164a6'] in dv-cinder-819778-3-iscsi is: [{'id': 'c3589b0b-43e0-46da-93f9-ec8e7a1164a6', 'name': 'tempest-TestMinimumBasicScenario-468826625-router', 'tenant_id': '3102b9c0f7ea45048750ae3c81085631', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:12Z', 'updated_at': '2021-12-08T11:38:41Z', 'revision_number': 6, 'project_id': '3102b9c0f7ea45048750ae3c81085631', 'gw_port_host': None}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:38:42.112585 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f1777098-58f2-4313-ba8e-b0530030a7ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.115494 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f1777098-58f2-4313-ba8e-b0530030a7ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.117267 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-f1777098-58f2-4313-ba8e-b0530030a7ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "DELETE /v2.0/floatingips/07f6101c-247e-4ed1-a7fa-bfb3e71fdaa3 HTTP/1.1" status: 204 len: 168 time: 0.5269208 Dec 08 11:38:42.162069 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.191424 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Pushing event deleted for resources: {'Port': ['ID=daeaa3c9-fb8a-43b5-b80f-6094f617715e,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:42.226150 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-29e86e47-5214-4e18-9e8e-783df672818a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.257062 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7889737'] for router_gateway, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.306722 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-29e86e47-5214-4e18-9e8e-783df672818a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.310687 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-29e86e47-5214-4e18-9e8e-783df672818a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.347581 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7895253', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32185'] for router, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.349817 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.352878 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29e86e47-5214-4e18-9e8e-783df672818a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2c8ad4d-529a-4db6-97f0-eb8ce2a52995,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:42.361192 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-29e86e47-5214-4e18-9e8e-783df672818a admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=a340e85409e04ced9939d04e70ba5749&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3156419 Dec 08 11:38:42.361432 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57672) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:42.403349 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7895086'] for router, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.404446 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Fanout notify agent at l3_agent the message router_deleted on router c3589b0b-43e0-46da-93f9-ec8e7a1164a6 {{(pid=102317) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 08 11:38:42.410968 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dd009dbc-59ba-476a-b3d3-544a5a16bd31 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.411451 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] Publish callbacks [] for router, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.416231 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57674) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:42.417020 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-b4b22a06-b5a5-4635-b570-5c5b53b4cf79 admin admin] 10.222.0.66 "DELETE /v2.0/routers/c3589b0b-43e0-46da-93f9-ec8e7a1164a6 HTTP/1.1" status: 204 len: 168 time: 0.9226635 Dec 08 11:38:42.451845 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57676) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:42.461068 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-79f61ea1-a989-4416-b846-ec6eb1143b58 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1572057722', 'description': 'tempest-description--740352684'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:38:42.474632 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dd009dbc-59ba-476a-b3d3-544a5a16bd31 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.516400 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_v2 [None req-58a67f1c-2aa0-43f3-8d56-6c1c52af505c admin admin] Deleting subnet 07f39602-a4ed-4df9-a6e2-9c0943b66135 {{(pid=102318) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:38:42.528952 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-58a67f1c-2aa0-43f3-8d56-6c1c52af505c admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.554350 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-79f61ea1-a989-4416-b846-ec6eb1143b58 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.586417 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-58a67f1c-2aa0-43f3-8d56-6c1c52af505c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16370044'] for subnet, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.615025 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dd009dbc-59ba-476a-b3d3-544a5a16bd31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.617657 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dd009dbc-59ba-476a-b3d3-544a5a16bd31 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.618807 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-dd009dbc-59ba-476a-b3d3-544a5a16bd31 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/d2c8ad4d-529a-4db6-97f0-eb8ce2a52995 HTTP/1.1" status: 204 len: 168 time: 0.2564666 Dec 08 11:38:42.649419 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd009dbc-59ba-476a-b3d3-544a5a16bd31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2c8ad4d-529a-4db6-97f0-eb8ce2a52995,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:42.742866 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-79f61ea1-a989-4416-b846-ec6eb1143b58 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.744298 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-58a67f1c-2aa0-43f3-8d56-6c1c52af505c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.774832 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-79f61ea1-a989-4416-b846-ec6eb1143b58 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.814133 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-79f61ea1-a989-4416-b846-ec6eb1143b58 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.815407 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-79f61ea1-a989-4416-b846-ec6eb1143b58 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.3588042 Dec 08 11:38:42.818466 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57682) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:42.818871 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79f61ea1-a989-4416-b846-ec6eb1143b58 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event updated for resources: {'SecurityGroup': ['ID=80c24f36-bbc4-45e3-bd16-0aa2125af2b2,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:42.825779 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-c7fa5607-7cd5-44a9-ba5b-dac808753df6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Request body: {'security_group_rule': {'security_group_id': '80c24f36-bbc4-45e3-bd16-0aa2125af2b2', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:38:42.846121 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-58a67f1c-2aa0-43f3-8d56-6c1c52af505c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4572160', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-16496636'] for subnet, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.858223 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c7fa5607-7cd5-44a9-ba5b-dac808753df6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.871024 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58a67f1c-2aa0-43f3-8d56-6c1c52af505c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=07f39602-a4ed-4df9-a6e2-9c0943b66135,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:42.875032 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-58a67f1c-2aa0-43f3-8d56-6c1c52af505c admin admin] Publish callbacks [] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.877875 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-58a67f1c-2aa0-43f3-8d56-6c1c52af505c admin admin] 10.222.0.66 "DELETE /v2.0/subnets/07f39602-a4ed-4df9-a6e2-9c0943b66135 HTTP/1.1" status: 204 len: 168 time: 0.4607811 Dec 08 11:38:42.880263 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57684) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:42.892380 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd7bc210-6ee7-40d5-bcaa-23b85e1a9b95 None None] Network f5a54297-6b64-4f71-b9f2-2f9c14a03187 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:38:42.900323 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57686) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:42.936193 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c7fa5607-7cd5-44a9-ba5b-dac808753df6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.943011 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8e834e37-546d-42db-af09-5ad922b7d904 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.955996 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c7fa5607-7cd5-44a9-ba5b-dac808753df6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.961192 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:42.963954 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 00496e9d-a438-4edc-b803-98d3f6b8e626 no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:38:42.982482 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7fa5607-7cd5-44a9-ba5b-dac808753df6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f396bc5f-1bbe-4658-b408-3e29ee367d24,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:42.991898 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 00496e9d-a438-4edc-b803-98d3f6b8e626 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:38:42.992589 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 00496e9d-a438-4edc-b803-98d3f6b8e626 not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:38:42.997295 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:38:43.004063 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c7fa5607-7cd5-44a9-ba5b-dac808753df6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.005385 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-c7fa5607-7cd5-44a9-ba5b-dac808753df6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1846583 Dec 08 11:38:43.008738 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57688) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:43.013984 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-c1b68fbe-5d34-4497-9a6e-b95ed6e956a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Request body: {'security_group_rule': {'security_group_id': '80c24f36-bbc4-45e3-bd16-0aa2125af2b2', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:38:43.030850 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:38:43.031433 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 2ebdbac7-6fba-4bd2-bbec-7e49216db3fe not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:38:43.056209 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Deleting port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:38:43.056648 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.059938 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c1b68fbe-5d34-4497-9a6e-b95ed6e956a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.072758 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8e834e37-546d-42db-af09-5ad922b7d904 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.077640 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8e834e37-546d-42db-af09-5ad922b7d904 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.124234 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-8e834e37-546d-42db-af09-5ad922b7d904 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=6e6ec78e4abf41afb98b06ffd68e318a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2226648 Dec 08 11:38:43.125311 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e834e37-546d-42db-af09-5ad922b7d904 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=deb4f277-2524-4e83-ab4b-3ffca084c057,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:43.127201 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57690) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:43.181091 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] DHCP port deletion for f5a54297-6b64-4f71-b9f2-2f9c14a03187 request from dv-cinder-819778-3-iscsi {{(pid=102319) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 08 11:38:43.196734 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] For port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=090ae454-dacf-4b76-bd03-a9ff7b5fac1c,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:38:43.197125 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.215817 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Calling delete_port for 090ae454-dacf-4b76-bd03-a9ff7b5fac1c owned by network:dhcp {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:38:43.232316 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Deleting port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c {{(pid=102319) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:38:43.232793 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.238115 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-343fed4a-9c00-41de-bba9-6655cdccd508 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.256685 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c1b68fbe-5d34-4497-9a6e-b95ed6e956a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.294871 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c1b68fbe-5d34-4497-9a6e-b95ed6e956a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.301976 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] For port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=090ae454-dacf-4b76-bd03-a9ff7b5fac1c,segment=NetworkSegment(bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6),segment_id=bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:38:43.302372 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.305888 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-343fed4a-9c00-41de-bba9-6655cdccd508 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.316200 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Calling delete_port for 090ae454-dacf-4b76-bd03-a9ff7b5fac1c owned by network:dhcp {{(pid=102319) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:38:43.337509 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1b68fbe-5d34-4497-9a6e-b95ed6e956a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c2a5f4b9-8b87-45a1-b1cc-ea2d4ea16631,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:43.358521 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c1b68fbe-5d34-4497-9a6e-b95ed6e956a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.362832 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57692) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:43.362957 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-c1b68fbe-5d34-4497-9a6e-b95ed6e956a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3528636 Dec 08 11:38:43.367872 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Request body: {'floatingip': {'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:38:43.399541 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.410244 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.431865 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-343fed4a-9c00-41de-bba9-6655cdccd508 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.434566 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-343fed4a-9c00-41de-bba9-6655cdccd508 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.435771 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-343fed4a-9c00-41de-bba9-6655cdccd508 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/deb4f277-2524-4e83-ab4b-3ffca084c057 HTTP/1.1" status: 204 len: 168 time: 0.3053527 Dec 08 11:38:43.453649 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-343fed4a-9c00-41de-bba9-6655cdccd508 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=deb4f277-2524-4e83-ab4b-3ffca084c057,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:43.457160 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Pushing event deleted for resources: {'Port': ['ID=090ae454-dacf-4b76-bd03-a9ff7b5fac1c,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:43.467421 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] No DVR routers for this DVR port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c on host dv-cinder-819778-3-iscsi {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:38:43.476543 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737'] for port, after_delete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.517768 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] No DVR routers for this DVR port 090ae454-dacf-4b76-bd03-a9ff7b5fac1c on host dv-cinder-819778-3-iscsi {{(pid=102319) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:38:43.518821 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.520241 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Pushing event deleted for resources: {'Port': ['ID=090ae454-dacf-4b76-bd03-a9ff7b5fac1c,revision_number=None']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:43.543036 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:43.543036 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:43.543584 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:43.543969 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:43.544315 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:43.544649 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:43.544983 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:43.545345 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:43.545719 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:43.546103 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:43.546442 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:43.546769 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:43.547095 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44ca4db1-27b9-40ff-8c1c-80d44456c081 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:43.556531 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.588713 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f5a54297-6b64-4f71-b9f2-2f9c14a03187']}} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:43.605701 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6') {'for_net_delete': True} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:43.606007 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bcbfd2f2-37ad-45b7-a3ee-9903cf406fa6') {} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:43.615808 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16370039'] for segment, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.631661 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.638312 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Releasing vlan 289 on physical network physnet1 to pool {{(pid=102318) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4575654'] for segment, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: Traceback (most recent call last): Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: timer() Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: cb(*args, **kw) Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: return func(*args, **kwargs) Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: self._notify() Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: self.callback(batched_events) Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: event.method(event) Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: return f(self, *a, **k) Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._get(url).json() Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: return self.request(url, 'GET', **kwargs) Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:38:43.642839 dv-cinder-819778-3-iscsi neutron-server[102318]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:38:43.660612 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Allocated IP 172.27.2.27 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/c77e1417-5298-41c2-b074-b7ab2015f218) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:38:43.707064 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.712976 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.721394 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] 10.222.0.66 "DELETE /v2.0/networks/f5a54297-6b64-4f71-b9f2-2f9c14a03187 HTTP/1.1" status: 204 len: 168 time: 0.8354197 Dec 08 11:38:43.721394 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57698) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:43.735927 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51d31482-2b14-4ae8-adbf-1a60218b86f7 admin admin] Pushing event deleted for resources: {'Network': ['ID=f5a54297-6b64-4f71-b9f2-2f9c14a03187,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:43.784551 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.828604 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:43.866740 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:38:43.870058 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:38:43.873187 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:38:43.904917 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event updated for resources: {'Port': ['ID=c77e1417-5298-41c2-b074-b7ab2015f218,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:43.968046 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:44.011361 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:44.102983 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a9935911-8bda-4153-ab29-cb95ee84c0d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7897011'] for router_interface, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:44.171855 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:44.179085 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5648421'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:44.252105 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event updated for resources: {'Port': ['ID=c77e1417-5298-41c2-b074-b7ab2015f218,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:44.264943 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:44.281825 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:44.283077 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-ab938a34-aa13-4c40-b467-b98a16c36c3e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 0.9192078 Dec 08 11:38:44.369464 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-a9935911-8bda-4153-ab29-cb95ee84c0d3 admin admin] Deleting port a124b6f3-37e6-4602-830a-3285a1585a50 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:38:44.369978 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a9935911-8bda-4153-ab29-cb95ee84c0d3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:44.482511 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-a9935911-8bda-4153-ab29-cb95ee84c0d3 admin admin] For port a124b6f3-37e6-4602-830a-3285a1585a50, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=a124b6f3-37e6-4602-830a-3285a1585a50,segment=NetworkSegment(15bdd0ed-936d-41c5-b3bd-63dca39d9789),segment_id=15bdd0ed-936d-41c5-b3bd-63dca39d9789)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:38:44.482906 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a9935911-8bda-4153-ab29-cb95ee84c0d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:44.501519 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device daeaa3c9-fb8a-43b5-b80f-6094f617715e no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:38:44.506321 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-a9935911-8bda-4153-ab29-cb95ee84c0d3 admin admin] Calling delete_port for a124b6f3-37e6-4602-830a-3285a1585a50 owned by network:router_interface {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:38:44.521091 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-482c50ff-3645-44f5-b716-2910f3e310f7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?name=tempest-securitygroup--1572057722&fields=id&tenant_id=44406e332fd94f1a9dcd704577410a61 HTTP/1.1" status: 200 len: 267 time: 0.0737557 Dec 08 11:38:44.523025 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: daeaa3c9-fb8a-43b5-b80f-6094f617715e {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:38:44.523646 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device daeaa3c9-fb8a-43b5-b80f-6094f617715e not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:38:44.524297 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 090ae454-dacf-4b76-bd03-a9ff7b5fac1c no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:38:44.551147 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 090ae454-dacf-4b76-bd03-a9ff7b5fac1c {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:38:44.551463 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 090ae454-dacf-4b76-bd03-a9ff7b5fac1c not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:38:44.720826 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-b7c65067-8a55-40e4-b75d-14241561b75f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:44.722319 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-b7c65067-8a55-40e4-b75d-14241561b75f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 816 time: 0.1681452 Dec 08 11:38:44.756152 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-eb5948f3-14f2-4c18-9e77-ee28c33b9a87 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/quotas/44406e332fd94f1a9dcd704577410a61 HTTP/1.1" status: 200 len: 375 time: 0.0261528 Dec 08 11:38:44.835134 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a9935911-8bda-4153-ab29-cb95ee84c0d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:44.848000 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-59749a2d-cae2-4137-95dd-ff6339b16af3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0836253 Dec 08 11:38:44.871623 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9935911-8bda-4153-ab29-cb95ee84c0d3 admin admin] Pushing event deleted for resources: {'Port': ['ID=a124b6f3-37e6-4602-830a-3285a1585a50,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:45.101032 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a9935911-8bda-4153-ab29-cb95ee84c0d3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8074906', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7896871'] for router_interface, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:45.108786 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-9c71a5f3-5c36-4030-89fb-27649c5d7a9b service neutron] 10.222.0.66 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2426958 Dec 08 11:38:45.279949 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e363ac58-854d-4619-8d27-5989c01552a1 service neutron] 10.222.0.66 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1645112 Dec 08 11:38:45.387998 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a9935911-8bda-4153-ab29-cb95ee84c0d3 admin admin] Router b92702ae-4c49-4f76-81b7-ca5150f7e9c2 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:38:45.721341 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7c8cea04-3eb9-41ad-927b-9a3a5942b13d req-49e28bbf-c87d-439a-98ae-20f439caff3a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 210 time: 0.0334435 Dec 08 11:38:45.783609 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9935911-8bda-4153-ab29-cb95ee84c0d3 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:38:45.791635 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-a9935911-8bda-4153-ab29-cb95ee84c0d3 admin admin] 10.222.0.66 "PUT /v2.0/routers/b92702ae-4c49-4f76-81b7-ca5150f7e9c2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0707080 Dec 08 11:38:45.793956 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57756) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:45.797631 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fa59850-8ff6-41e2-abfa-ca78a4a87a31 None None] Sync routers for ids ['b92702ae-4c49-4f76-81b7-ca5150f7e9c2'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:38:45.809597 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fa59850-8ff6-41e2-abfa-ca78a4a87a31 None None] Routers {'b92702ae-4c49-4f76-81b7-ca5150f7e9c2'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:38:45.810207 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-0fa59850-8ff6-41e2-abfa-ca78a4a87a31 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:38:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['b92702ae-4c49-4f76-81b7-ca5150f7e9c2'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:45.911085 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Publish callbacks [] for router, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:45.946712 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-0fa59850-8ff6-41e2-abfa-ca78a4a87a31 None None] Set router b92702ae-4c49-4f76-81b7-ca5150f7e9c2 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:38:46.030602 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.101087 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Deleting port cf24cf71-3d0f-4982-87dd-2a3f70f2b08e {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:38:46.101471 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.182546 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] For port cf24cf71-3d0f-4982-87dd-2a3f70f2b08e, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=cf24cf71-3d0f-4982-87dd-2a3f70f2b08e,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:38:46.182907 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.198426 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Calling delete_port for cf24cf71-3d0f-4982-87dd-2a3f70f2b08e owned by network:router_gateway {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:38:46.217046 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-0fa59850-8ff6-41e2-abfa-ca78a4a87a31 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'name': 'tempest-TestMinimumBasicScenario-2024163828-router', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61'}], 'enable_snat': True}, 'gw_port_id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:38:44Z', 'revision_number': 5, 'project_id': '768a297d7e694199b80b2fa7f4671866', 'gw_port': {'id': 'cf24cf71-3d0f-4982-87dd-2a3f70f2b08e', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:07:09:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 290, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.61', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:32:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:46.242758 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fa59850-8ff6-41e2-abfa-ca78a4a87a31 None None] Checking router: b92702ae-4c49-4f76-81b7-ca5150f7e9c2 for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:38:46.250809 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fa59850-8ff6-41e2-abfa-ca78a4a87a31 None None] Routers {'b92702ae-4c49-4f76-81b7-ca5150f7e9c2'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:38:46.251403 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-0fa59850-8ff6-41e2-abfa-ca78a4a87a31 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:38:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['b92702ae-4c49-4f76-81b7-ca5150f7e9c2'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:46.337360 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-0fa59850-8ff6-41e2-abfa-ca78a4a87a31 None None] Set router b92702ae-4c49-4f76-81b7-ca5150f7e9c2 gateway port host: None {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:38:46.363759 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.394230 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-0fa59850-8ff6-41e2-abfa-ca78a4a87a31 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'name': 'tempest-TestMinimumBasicScenario-2024163828-router', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:38:46Z', 'revision_number': 6, 'project_id': '768a297d7e694199b80b2fa7f4671866', 'gw_port_host': None}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:46.394522 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Pushing event deleted for resources: {'Port': ['ID=cf24cf71-3d0f-4982-87dd-2a3f70f2b08e,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:46.421390 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fa59850-8ff6-41e2-abfa-ca78a4a87a31 None None] The sync data for ids ['b92702ae-4c49-4f76-81b7-ca5150f7e9c2'] in dv-cinder-819778-3-iscsi is: [{'id': 'b92702ae-4c49-4f76-81b7-ca5150f7e9c2', 'name': 'tempest-TestMinimumBasicScenario-2024163828-router', 'tenant_id': '768a297d7e694199b80b2fa7f4671866', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:32:17Z', 'updated_at': '2021-12-08T11:38:46Z', 'revision_number': 6, 'project_id': '768a297d7e694199b80b2fa7f4671866', 'gw_port_host': None}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:38:46.453320 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7889737'] for router_gateway, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.554835 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7895253', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32185'] for router, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.556907 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.621433 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7895086'] for router, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.621877 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b92702ae-4c49-4f76-81b7-ca5150f7e9c2 {{(pid=102318) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 08 11:38:46.626704 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] Publish callbacks [] for router, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.627842 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-cd8a6cb0-5c53-40ed-845d-3027035edd96 admin admin] 10.222.0.66 "DELETE /v2.0/routers/b92702ae-4c49-4f76-81b7-ca5150f7e9c2 HTTP/1.1" status: 204 len: 168 time: 0.8316009 Dec 08 11:38:46.630391 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57760) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:46.673726 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_v2 [None req-154b5945-636d-4e7a-a668-fd9a7bae192a admin admin] Deleting subnet 6ad3a8d0-0889-4cb7-801c-def529056ea9 {{(pid=102318) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:38:46.676768 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-154b5945-636d-4e7a-a668-fd9a7bae192a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.710245 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-154b5945-636d-4e7a-a668-fd9a7bae192a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16370044'] for subnet, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.797639 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-154b5945-636d-4e7a-a668-fd9a7bae192a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.852585 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e2658f1f-65b8-4e28-8eee-af3b36b1b83b req-b4234a1d-e659-40cf-939a-34a5bc75827d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 210 time: 0.0324275 Dec 08 11:38:46.876112 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-154b5945-636d-4e7a-a668-fd9a7bae192a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4572160', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-16496636'] for subnet, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.901298 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-154b5945-636d-4e7a-a668-fd9a7bae192a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6ad3a8d0-0889-4cb7-801c-def529056ea9,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:46.904871 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-154b5945-636d-4e7a-a668-fd9a7bae192a admin admin] Publish callbacks [] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:46.910376 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-154b5945-636d-4e7a-a668-fd9a7bae192a admin admin] 10.222.0.66 "DELETE /v2.0/subnets/6ad3a8d0-0889-4cb7-801c-def529056ea9 HTTP/1.1" status: 204 len: 168 time: 0.2767744 Dec 08 11:38:46.910579 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57764) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:46.914002 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-907a454c-0505-4f5a-838b-bc3aea710288 None None] Network 6a5ef37d-afdd-4d25-a278-64647e2c4759 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:38:46.985364 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.041424 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Deleting port f0d99c11-f976-4a6b-a95d-292a9bdeb5aa {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:38:47.041765 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.102064 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] For port f0d99c11-f976-4a6b-a95d-292a9bdeb5aa, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=f0d99c11-f976-4a6b-a95d-292a9bdeb5aa,segment=NetworkSegment(15bdd0ed-936d-41c5-b3bd-63dca39d9789),segment_id=15bdd0ed-936d-41c5-b3bd-63dca39d9789)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:38:47.102462 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.118761 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Calling delete_port for f0d99c11-f976-4a6b-a95d-292a9bdeb5aa owned by network:dhcp {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:38:47.197420 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.203197 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a93407b4-9d32-4065-bf6a-b8e7f92364f0 None None] DHCP port deletion for 6a5ef37d-afdd-4d25-a278-64647e2c4759 request from dv-cinder-819778-3-iscsi {{(pid=102319) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 08 11:38:47.224995 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Pushing event deleted for resources: {'Port': ['ID=f0d99c11-f976-4a6b-a95d-292a9bdeb5aa,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:47.228904 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] No DVR routers for this DVR port f0d99c11-f976-4a6b-a95d-292a9bdeb5aa on host dv-cinder-819778-3-iscsi {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:38:47.304351 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.325275 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6a5ef37d-afdd-4d25-a278-64647e2c4759']}} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:47.334225 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '15bdd0ed-936d-41c5-b3bd-63dca39d9789') {'for_net_delete': True} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:47.334516 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '15bdd0ed-936d-41c5-b3bd-63dca39d9789') {} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:38:47.344258 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16370039'] for segment, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.358103 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.364535 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Releasing vlan 263 on physical network physnet1 to pool {{(pid=102318) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:38:47.364915 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4575654'] for segment, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: Traceback (most recent call last): Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: timer() Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: cb(*args, **kw) Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: return func(*args, **kwargs) Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: self._notify() Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: self.callback(batched_events) Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: event.method(event) Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: return f(self, *a, **k) Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._get(url).json() Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: return self.request(url, 'GET', **kwargs) Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:38:47.367510 dv-cinder-819778-3-iscsi neutron-server[102318]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:38:47.426302 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.431960 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.435277 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] 10.222.0.66 "DELETE /v2.0/networks/6a5ef37d-afdd-4d25-a278-64647e2c4759 HTTP/1.1" status: 204 len: 168 time: 0.5237026 Dec 08 11:38:47.447471 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31ed2295-d951-4c64-a2df-017ba2c8f434 admin admin] Pushing event deleted for resources: {'Network': ['ID=6a5ef37d-afdd-4d25-a278-64647e2c4759,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:47.605737 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57772) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:47.648806 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-50aa1cad-4734-4fdc-9d6e-eef23b353784 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=3102b9c0f7ea45048750ae3c81085631&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0398400 Dec 08 11:38:47.649438 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57774) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:47.655536 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.697471 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-79e7cc58-74a5-48c7-89b9-186161297161 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.717859 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-79e7cc58-74a5-48c7-89b9-186161297161 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.767355 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-79e7cc58-74a5-48c7-89b9-186161297161 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.769966 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-79e7cc58-74a5-48c7-89b9-186161297161 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:47.771100 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-79e7cc58-74a5-48c7-89b9-186161297161 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/18816c08-841a-4a06-aa5d-1bb76e44c9f4 HTTP/1.1" status: 204 len: 168 time: 0.1205559 Dec 08 11:38:47.778729 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79e7cc58-74a5-48c7-89b9-186161297161 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18816c08-841a-4a06-aa5d-1bb76e44c9f4,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:47.960540 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4bfbec35-85a7-4305-8e82-19856945ff00 req-eb3f544a-2c44-4422-a18a-f2723c504f2f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 210 time: 0.0318463 Dec 08 11:38:48.083375 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57784) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:48.125358 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-2dafde9b-a42b-4c51-bc4a-32c67120e68b admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=768a297d7e694199b80b2fa7f4671866&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0397372 Dec 08 11:38:48.126747 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57786) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:48.174923 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3283671a-92ae-47f6-860b-5bc8faab836a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:48.203038 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3283671a-92ae-47f6-860b-5bc8faab836a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:48.249647 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3283671a-92ae-47f6-860b-5bc8faab836a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:48.252105 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3283671a-92ae-47f6-860b-5bc8faab836a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:48.253262 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-3283671a-92ae-47f6-860b-5bc8faab836a admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/e4c96aa3-2204-4de2-b1ac-5ce9ef694a9b HTTP/1.1" status: 204 len: 168 time: 0.1255765 Dec 08 11:38:48.260882 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3283671a-92ae-47f6-860b-5bc8faab836a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4c96aa3-2204-4de2-b1ac-5ce9ef694a9b,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:48.482760 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device cf24cf71-3d0f-4982-87dd-2a3f70f2b08e no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:38:48.503286 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: cf24cf71-3d0f-4982-87dd-2a3f70f2b08e {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:38:48.503543 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device cf24cf71-3d0f-4982-87dd-2a3f70f2b08e not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:38:48.503972 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device a124b6f3-37e6-4602-830a-3285a1585a50 no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:38:48.524475 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: a124b6f3-37e6-4602-830a-3285a1585a50 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:38:48.524823 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device a124b6f3-37e6-4602-830a-3285a1585a50 not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:38:48.525278 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device f0d99c11-f976-4a6b-a95d-292a9bdeb5aa no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:38:48.545775 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: f0d99c11-f976-4a6b-a95d-292a9bdeb5aa {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:38:48.546131 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device f0d99c11-f976-4a6b-a95d-292a9bdeb5aa not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:38:49.057679 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9394d55b-1731-449c-8060-11b77dffd6fb req-a3333f28-0bb9-498d-8994-bc7298a743dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 210 time: 0.0257967 Dec 08 11:38:50.142491 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-55b61809-0c44-4db1-b1a8-88186219ac8e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:50.144068 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-55b61809-0c44-4db1-b1a8-88186219ac8e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.61 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 816 time: 0.1224363 Dec 08 11:38:50.171378 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5240aea7-590c-469f-8674-b9ae186b8e42 req-d7ec5ea1-4be1-4b8a-98d9-1eb783077107 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 210 time: 0.0262690 Dec 08 11:38:50.444138 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-760daae6-48e6-41fb-bb28-f076206ca047 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=44406e332fd94f1a9dcd704577410a61 HTTP/1.1" status: 200 len: 380 time: 0.0539424 Dec 08 11:38:50.455162 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-1e0df3fe-60b9-42e6-9dfe-868b0ba56904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Request body: {'port': {'device_id': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'admin_state_up': True, 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'security_groups': ['80c24f36-bbc4-45e3-bd16-0aa2125af2b2']}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:38:50.561906 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-1e0df3fe-60b9-42e6-9dfe-868b0ba56904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Made reservation on behalf of 44406e332fd94f1a9dcd704577410a61 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:38:50.565373 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-1e0df3fe-60b9-42e6-9dfe-868b0ba56904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:50.688045 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-1e0df3fe-60b9-42e6-9dfe-868b0ba56904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Allocated IP 172.20.0.11 (fd37a1fc-3614-462b-92a2-b41260c949a2/62551f0b-3202-4a06-842d-a67bd8fa187b/d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:38:50.821756 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-1e0df3fe-60b9-42e6-9dfe-868b0ba56904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:50.854029 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-1e0df3fe-60b9-42e6-9dfe-868b0ba56904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:50.898041 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-1e0df3fe-60b9-42e6-9dfe-868b0ba56904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Network fd37a1fc-3614-462b-92a2-b41260c949a2 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:38:50.902945 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-1e0df3fe-60b9-42e6-9dfe-868b0ba56904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:38:50.906679 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-1e0df3fe-60b9-42e6-9dfe-868b0ba56904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:38:50.913480 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e0df3fe-60b9-42e6-9dfe-868b0ba56904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event updated for resources: {'Port': ['ID=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:50.959027 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-1e0df3fe-60b9-42e6-9dfe-868b0ba56904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:50.960177 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-1e0df3fe-60b9-42e6-9dfe-868b0ba56904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:50.977039 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-1e0df3fe-60b9-42e6-9dfe-868b0ba56904 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5254676 Dec 08 11:38:51.024295 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Request body: {'port': {'device_id': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:38:51.078306 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:51.100764 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-609050c9-3a92-473f-8058-d5ee51445705 None None] Provisioning complete for port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:38:51.101338 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-609050c9-3a92-473f-8058-d5ee51445705 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:51.135191 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-609050c9-3a92-473f-8058-d5ee51445705 None None] Port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:38:51.334218 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f866304-fa9b-4b13-9c6d-b82e249af628 req-23d65dcb-7545-4369-b943-d37eb377a9a4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:51.336268 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2f866304-fa9b-4b13-9c6d-b82e249af628 req-23d65dcb-7545-4369-b943-d37eb377a9a4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 932 time: 0.0855384 Dec 08 11:38:51.417338 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:38:51.427694 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2f866304-fa9b-4b13-9c6d-b82e249af628 req-0e947d6f-9e0a-4a74-83ec-9ecc918b9f96 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0831704 Dec 08 11:38:51.430115 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:51.443474 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Transition to ACTIVE for port object d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:38:51.448102 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:51.496533 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Pushing event updated for resources: {'Port': ['ID=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:51.525604 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:51.525866 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:51.526221 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:51.526691 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:51.526885 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:51.527214 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:51.527539 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:51.527865 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:51.528188 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:51.528514 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:51.528836 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:51.529176 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:51.529502 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:38:51.582758 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Attempting to bind port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:38:51.583167 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Attempting to bind port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:38:51.583577 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Attempting to bind port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee on network fd37a1fc-3614-462b-92a2-b41260c949a2 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:38:51.588592 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee on network fd37a1fc-3614-462b-92a2-b41260c949a2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:38:51.588979 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Attempting to bind port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee on network fd37a1fc-3614-462b-92a2-b41260c949a2 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:38:51.595934 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 38, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:38:51.596498 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Checking segment: {'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:38:51.597045 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Bound using segment: {'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:38:51.597507 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Bound port: d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '394a978e-a69b-4e58-ad01-1710ac7a878b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 278, 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:38:51.597864 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:51.664825 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] For port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:38:51.667952 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] For port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:38:51.672843 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:51.707012 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:51.707012 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:51.708231 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] 10.222.0.61 "PUT /v2.0/ports/d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee HTTP/1.1" status: 200 len: 1094 time: 0.6888251 Dec 08 11:38:51.708645 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:38:51.712154 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967" -d '{"events": [{"name": "network-changed", "server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:38:51.741384 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e28bdfa5-c24c-4b21-8111-7c143e3bec4c service neutron] Pushing event updated for resources: {'Port': ['ID=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:51.766763 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:38:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03ec281a-fe0b-4021-9436-b1e28837f4a9 x-openstack-request-id: req-03ec281a-fe0b-4021-9436-b1e28837f4a9 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:38:51.767231 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:38:51.767518 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-03ec281a-fe0b-4021-9436-b1e28837f4a9 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:38:51.767952 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'status': 'completed', 'code': 200} Dec 08 11:38:51.823036 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-9548ace6-92c4-444f-89ba-1023768e70ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:51.824590 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-9548ace6-92c4-444f-89ba-1023768e70ee service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 1097 time: 0.0470483 Dec 08 11:38:51.870942 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-0d061e21-33ea-42fa-8502-e14fbb901ed3 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee HTTP/1.1" status: 200 len: 217 time: 0.0363176 Dec 08 11:38:51.923246 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-30379fce-b02f-40a8-a769-c565fdec86d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:51.925362 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-30379fce-b02f-40a8-a769-c565fdec86d5 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 200 len: 855 time: 0.0464947 Dec 08 11:38:51.974100 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-f4b35ede-d248-40cf-8b6e-7389373bc68c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:51.977157 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-f4b35ede-d248-40cf-8b6e-7389373bc68c service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=fd37a1fc-3614-462b-92a2-b41260c949a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0445590 Dec 08 11:38:52.065756 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-88649e96-028a-483e-b62a-923fa43e2b1e service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0807648 Dec 08 11:38:52.160424 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d431cd2-5cfd-4dbf-a4b3-41fa5575f035 req-6b12f287-6a4b-4345-a07e-2e56038c2d7a service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874598 Dec 08 11:38:52.247205 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-c837f4f1-5898-4b83-8330-9e089a5a7521 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:52.248628 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-c837f4f1-5898-4b83-8330-9e089a5a7521 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 1097 time: 0.0408607 Dec 08 11:38:52.342014 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-d96f78b9-21bc-4ff3-b564-7c33ca8197b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:52.343482 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-d96f78b9-21bc-4ff3-b564-7c33ca8197b0 service neutron] 10.222.0.61 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 917 time: 0.0868924 Dec 08 11:38:52.388927 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-72172880-1ea5-44ee-9b56-2dd9e394ca26 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee HTTP/1.1" status: 200 len: 217 time: 0.0364525 Dec 08 11:38:52.440284 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-b0fba168-f371-4b92-94f0-54e13bb6c0dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:52.441863 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-b0fba168-f371-4b92-94f0-54e13bb6c0dc service neutron] 10.222.0.61 "GET /v2.0/subnets?id=62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 200 len: 855 time: 0.0436814 Dec 08 11:38:52.467582 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-29e6bf38-c881-4834-8ce0-8cc50d2e3aac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:52.490123 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-405b2127-2ae6-4448-bfe2-e6dfd18a3556 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:52.491759 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-405b2127-2ae6-4448-bfe2-e6dfd18a3556 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=fd37a1fc-3614-462b-92a2-b41260c949a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0430179 Dec 08 11:38:52.616330 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69d20e21-703f-4f77-939e-5cbb8edfca05 req-6666cac2-06b3-4014-a424-717759d5d82a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:52.617831 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-69d20e21-703f-4f77-939e-5cbb8edfca05 req-6666cac2-06b3-4014-a424-717759d5d82a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0994601 Dec 08 11:38:52.623124 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-879e7f92-e556-4303-a453-09ad14a12998 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1243472 Dec 08 11:38:52.714189 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-69d20e21-703f-4f77-939e-5cbb8edfca05 req-f1acb64e-ccb7-44e7-82b7-5ffa090424e0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0901232 Dec 08 11:38:52.741821 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e8f42a61-fe35-44fd-bbdf-bd95d2a43967 req-68c54064-058b-4f23-8f76-98a5aa0315b0 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1047165 Dec 08 11:38:53.830805 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7223e8c3-1a43-40ca-93c5-22eb331c7cb9 req-0561634a-d6c2-40fe-a884-cf75b1b5136b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:53.832236 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7223e8c3-1a43-40ca-93c5-22eb331c7cb9 req-0561634a-d6c2-40fe-a884-cf75b1b5136b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0483854 Dec 08 11:38:53.878482 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7223e8c3-1a43-40ca-93c5-22eb331c7cb9 req-23a0d7fb-de35-4e43-b549-92a70444d1ca tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398090 Dec 08 11:38:54.107590 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57854) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:54.210249 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b5fb6281-7b81-405b-bdb3-53a2bb597079 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:54.282458 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b5fb6281-7b81-405b-bdb3-53a2bb597079 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:54.286084 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-b5fb6281-7b81-405b-bdb3-53a2bb597079 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:54.327915 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-b5fb6281-7b81-405b-bdb3-53a2bb597079 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=77375f3f85bb480bbb795534a0423ba4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2192297 Dec 08 11:38:54.329007 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5fb6281-7b81-405b-bdb3-53a2bb597079 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=10508cf5-cfae-4df4-aaa9-baa875cfc8ca,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:54.330712 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 57858) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:38:54.378371 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0f146427-946b-4b30-a7d1-b2fe0c936b4e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:54.399500 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0f146427-946b-4b30-a7d1-b2fe0c936b4e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:54.444772 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0f146427-946b-4b30-a7d1-b2fe0c936b4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:54.447394 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0f146427-946b-4b30-a7d1-b2fe0c936b4e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:54.448545 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-0f146427-946b-4b30-a7d1-b2fe0c936b4e admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/10508cf5-cfae-4df4-aaa9-baa875cfc8ca HTTP/1.1" status: 204 len: 168 time: 0.1168160 Dec 08 11:38:54.456383 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f146427-946b-4b30-a7d1-b2fe0c936b4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=10508cf5-cfae-4df4-aaa9-baa875cfc8ca,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:54.698430 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-f35e6580-f4b2-450b-8f06-5e02d7671f6c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:54.993675 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aa9ff16-7831-4ab7-acac-1203e4301b0d req-c28ab477-2747-4044-8865-1e2fc69a4700 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:54.995110 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5aa9ff16-7831-4ab7-acac-1203e4301b0d req-c28ab477-2747-4044-8865-1e2fc69a4700 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0472908 Dec 08 11:38:55.040834 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5aa9ff16-7831-4ab7-acac-1203e4301b0d req-1c0d5c29-475d-47f5-947f-f7400ed6b879 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399039 Dec 08 11:38:55.682784 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:38:55.774320 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:38:55.794552 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'port_id': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'mac_address': 'fa:16:3e:63:16:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 278, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:38:55.801260 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:55.837041 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:55.849874 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:38:55.870281 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:38:55.873810 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:55.919489 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:56.156605 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a88fbf5e-ae6d-4cf4-bc17-c67f2b97f0e9 req-694cdaeb-84e1-4997-aea0-196659dfb2f8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:56.158112 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a88fbf5e-ae6d-4cf4-bc17-c67f2b97f0e9 req-694cdaeb-84e1-4997-aea0-196659dfb2f8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 945 time: 0.0476382 Dec 08 11:38:56.204579 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a88fbf5e-ae6d-4cf4-bc17-c67f2b97f0e9 req-300f05e7-b8c9-45f5-9910-2e380a7b2aad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397379 Dec 08 11:38:56.252716 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:38:57.149323 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:57.323972 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ef028da-a7d2-4b51-8146-dc28a108b32b req-5942e148-1d42-4ffc-9b9b-91b2fdff4f2d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:57.325436 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6ef028da-a7d2-4b51-8146-dc28a108b32b req-5942e148-1d42-4ffc-9b9b-91b2fdff4f2d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 945 time: 0.0511241 Dec 08 11:38:57.370952 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6ef028da-a7d2-4b51-8146-dc28a108b32b req-25969bb2-89e2-4708-b3cf-6c321a283209 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395534 Dec 08 11:38:57.693295 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:38:57.746219 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:38:57.749941 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:38:57.750307 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:57.827725 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:57.851755 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:38:57.854051 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2e4e6419-22d0-418f-bed2-f60f35478f98" -d '{"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-plugged", "status": "completed", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:38:57.867622 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:38:57.871933 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:57.917240 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:38:58.059148 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:38:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-629687a3-42a3-4026-b305-e7bd834407e6 x-openstack-request-id: req-629687a3-42a3-4026-b305-e7bd834407e6 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:38:58.059449 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-plugged", "status": "completed", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:38:58.059709 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-629687a3-42a3-4026-b305-e7bd834407e6 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:38:58.060104 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'code': 200} Dec 08 11:38:58.164537 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:38:58.224580 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b063e60d-fd9a-418f-90a7-55ead9ba4926 req-c7203687-c734-434b-9eff-7508035afbbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:58.226749 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b063e60d-fd9a-418f-90a7-55ead9ba4926 req-c7203687-c734-434b-9eff-7508035afbbe service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 1099 time: 0.0396135 Dec 08 11:38:58.271123 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b063e60d-fd9a-418f-90a7-55ead9ba4926 req-554a552f-4ae5-4876-9a42-67f65bbdc24c service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0363543 Dec 08 11:38:58.488060 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e11bbd0-5808-4610-8abd-0fb22b607f80 req-6c670679-f5d4-434a-98c1-86b504f87e1d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:58.489524 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0e11bbd0-5808-4610-8abd-0fb22b607f80 req-6c670679-f5d4-434a-98c1-86b504f87e1d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0471687 Dec 08 11:38:58.539470 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0e11bbd0-5808-4610-8abd-0fb22b607f80 req-8c4ffc25-8350-4a0a-8371-612f8b2ae7be tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433581 Dec 08 11:38:59.665555 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-471310f3-eab1-4fe1-82c3-ae34209eacff req-66d14438-e07f-48b4-898d-9d560f4f9dbb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:38:59.667043 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-471310f3-eab1-4fe1-82c3-ae34209eacff req-66d14438-e07f-48b4-898d-9d560f4f9dbb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0518079 Dec 08 11:38:59.713121 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-471310f3-eab1-4fe1-82c3-ae34209eacff req-79dd0b84-18a9-4aba-b537-4fc903e23111 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399978 Dec 08 11:39:00.020584 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4a9988d-2935-41ab-ad47-4448b6063461 req-82e0f134-e8e9-4a16-a354-7b2845cefc9f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:00.022066 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4a9988d-2935-41ab-ad47-4448b6063461 req-82e0f134-e8e9-4a16-a354-7b2845cefc9f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0476997 Dec 08 11:39:00.070393 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4a9988d-2935-41ab-ad47-4448b6063461 req-78ef3656-ef5e-4e5c-a281-7ae84c090866 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424669 Dec 08 11:39:00.835456 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-158c1022-297f-44de-b109-a4dba25208d2 req-a8615424-b0f1-4c14-88f7-6553f6a2ebc5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:00.837655 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-158c1022-297f-44de-b109-a4dba25208d2 req-a8615424-b0f1-4c14-88f7-6553f6a2ebc5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0515609 Dec 08 11:39:00.884023 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-158c1022-297f-44de-b109-a4dba25208d2 req-1963cdd3-2082-4bcf-be4a-83ad5292defe tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404599 Dec 08 11:39:00.996708 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28ac1200-b27e-48f7-9f32-d8603d18d639 req-45f314fc-99de-42b6-bea1-f27016785692 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:00.998098 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-28ac1200-b27e-48f7-9f32-d8603d18d639 req-45f314fc-99de-42b6-bea1-f27016785692 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0472400 Dec 08 11:39:01.006318 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 57888) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:39:01.011054 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-867325fc-509f-4331-87ef-1c152d09e5f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Request body: {'floatingip': {'port_id': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:39:01.051294 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-867325fc-509f-4331-87ef-1c152d09e5f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:01.499139 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f59a7743-c062-42a5-92a7-74eb157d8364 req-8bdaf642-9977-4835-bff7-99e18edc51d0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:01.500590 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f59a7743-c062-42a5-92a7-74eb157d8364 req-8bdaf642-9977-4835-bff7-99e18edc51d0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.3619089 Dec 08 11:39:01.614203 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f59a7743-c062-42a5-92a7-74eb157d8364 req-7a1ed929-62d3-479b-9c1a-1455254fbc62 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0868218 Dec 08 11:39:01.797878 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-867325fc-509f-4331-87ef-1c152d09e5f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:01.801490 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-867325fc-509f-4331-87ef-1c152d09e5f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:01.899233 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [None req-867325fc-509f-4331-87ef-1c152d09e5f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Floating IP d3b3d246-d42e-4a15-8d8e-079dd448dd08 associated. External IP: 172.27.2.27, port: d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee. Dec 08 11:39:02.093019 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-867325fc-509f-4331-87ef-1c152d09e5f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:39:02.196636 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-867325fc-509f-4331-87ef-1c152d09e5f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:39:02.201500 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-867325fc-509f-4331-87ef-1c152d09e5f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:02.206550 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ce0df23-f529-4782-9ed0-272435ad2b0b None None] Sync routers for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:39:02.216777 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ce0df23-f529-4782-9ed0-272435ad2b0b None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:39:02.217431 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-5ce0df23-f529-4782-9ed0-272435ad2b0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:38:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:39:02.231775 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-867325fc-509f-4331-87ef-1c152d09e5f5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "PUT /v2.0/floatingips/d3b3d246-d42e-4a15-8d8e-079dd448dd08 HTTP/1.1" status: 200 len: 991 time: 1.2244325 Dec 08 11:39:02.232367 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:39:02.234680 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a771d047-a413-43fc-9189-6e473848762a" -d '{"events": [{"name": "network-changed", "server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:39:02.270662 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:39:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fbf0ef9a-e9bc-4527-9f14-10c2cfd8e6ad x-openstack-request-id: req-fbf0ef9a-e9bc-4527-9f14-10c2cfd8e6ad {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:39:02.270954 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:39:02.271208 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-fbf0ef9a-e9bc-4527-9f14-10c2cfd8e6ad {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:39:02.271609 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'status': 'completed', 'code': 200} Dec 08 11:39:02.328115 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-5ce0df23-f529-4782-9ed0-272435ad2b0b None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:39:02.338803 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a771d047-a413-43fc-9189-6e473848762a req-6aa28669-48b9-461b-a8e8-e25b8e7027df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:02.340234 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a771d047-a413-43fc-9189-6e473848762a req-6aa28669-48b9-461b-a8e8-e25b8e7027df service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 1099 time: 0.0415530 Dec 08 11:39:02.430242 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a771d047-a413-43fc-9189-6e473848762a req-92ec0e99-ec6e-4e8b-be96-c533b5d9ed9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:02.431712 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a771d047-a413-43fc-9189-6e473848762a req-92ec0e99-ec6e-4e8b-be96-c533b5d9ed9f service neutron] 10.222.0.61 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 917 time: 0.0828240 Dec 08 11:39:02.500456 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a771d047-a413-43fc-9189-6e473848762a req-d20d6080-07f8-4ed3-b193-27dca4329f7f service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee HTTP/1.1" status: 200 len: 999 time: 0.0611186 Dec 08 11:39:02.551202 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a771d047-a413-43fc-9189-6e473848762a req-1fc8426d-49c1-488e-abc6-67664d1d719b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:02.552663 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a771d047-a413-43fc-9189-6e473848762a req-1fc8426d-49c1-488e-abc6-67664d1d719b service neutron] 10.222.0.61 "GET /v2.0/subnets?id=62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 200 len: 855 time: 0.0433564 Dec 08 11:39:02.591983 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-5ce0df23-f529-4782-9ed0-272435ad2b0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'd3b3d246-d42e-4a15-8d8e-079dd448dd08', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'floating_ip_address': '172.27.2.27', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'port_id': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 530, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'mac_address': 'fa:16:3e:63:16:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:38:43Z', 'updated_at': '2021-12-08T11:39:01Z', 'revision_number': 1, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:27Z', 'revision_number': 5, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:39:02.598637 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a771d047-a413-43fc-9189-6e473848762a req-fb364a32-2a46-415d-a9dd-a3d3c236ba57 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:02.600155 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a771d047-a413-43fc-9189-6e473848762a req-fb364a32-2a46-415d-a9dd-a3d3c236ba57 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=fd37a1fc-3614-462b-92a2-b41260c949a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0397189 Dec 08 11:39:02.621819 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ce0df23-f529-4782-9ed0-272435ad2b0b None None] Checking router: d1e1bffc-ba94-4ef3-b10a-203d4ed7519f for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:39:02.630142 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ce0df23-f529-4782-9ed0-272435ad2b0b None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:39:02.630744 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-5ce0df23-f529-4782-9ed0-272435ad2b0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:38:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:39:02.718800 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a771d047-a413-43fc-9189-6e473848762a req-3062b199-bd03-46e7-9f35-2b6544455b83 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1105082 Dec 08 11:39:02.737247 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-5ce0df23-f529-4782-9ed0-272435ad2b0b None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:39:02.780568 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c19e8b5b-fcd6-4d28-a2c7-acd7cfbffecd req-5d86af81-beb2-495c-ad31-f5d0adce3cdd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:02.782085 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c19e8b5b-fcd6-4d28-a2c7-acd7cfbffecd req-5d86af81-beb2-495c-ad31-f5d0adce3cdd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0959380 Dec 08 11:39:02.857214 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a771d047-a413-43fc-9189-6e473848762a req-c3ff21f2-a420-4622-ad0c-93c93250bf0d service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1301880 Dec 08 11:39:02.861050 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c19e8b5b-fcd6-4d28-a2c7-acd7cfbffecd req-1d2bee8c-f8a4-4671-93c3-7dea957667c8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0715313 Dec 08 11:39:02.959264 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-5ce0df23-f529-4782-9ed0-272435ad2b0b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'd3b3d246-d42e-4a15-8d8e-079dd448dd08', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'floating_ip_address': '172.27.2.27', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'port_id': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 530, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'mac_address': 'fa:16:3e:63:16:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:38:43Z', 'updated_at': '2021-12-08T11:39:01Z', 'revision_number': 1, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:27Z', 'revision_number': 5, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:39:02.985594 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ce0df23-f529-4782-9ed0-272435ad2b0b None None] The sync data for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi is: [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'd3b3d246-d42e-4a15-8d8e-079dd448dd08', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'floating_ip_address': '172.27.2.27', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'port_id': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 530, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'mac_address': 'fa:16:3e:63:16:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:38:43Z', 'updated_at': '2021-12-08T11:39:01Z', 'revision_number': 1, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:27Z', 'revision_number': 5, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:39:03.169504 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b736862a-0788-402e-bfd0-8bfa8d687066 None None] New status for floating IP d3b3d246-d42e-4a15-8d8e-079dd448dd08: ACTIVE {{(pid=102320) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:39:03.974934 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4235a9e-7f95-4251-9fa9-dcdb5bdad1a6 req-71c82445-8ba5-4498-ac63-4fbb57b65ae6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:03.976889 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f4235a9e-7f95-4251-9fa9-dcdb5bdad1a6 req-71c82445-8ba5-4498-ac63-4fbb57b65ae6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0485246 Dec 08 11:39:04.024422 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f4235a9e-7f95-4251-9fa9-dcdb5bdad1a6 req-7ef293cc-9d75-41b6-b58e-b89ef1ee28a1 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416701 Dec 08 11:39:05.135796 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22fc5292-74b4-4a90-9be2-e7c82090213a req-2b953e54-3689-4b9d-897b-093d07950450 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:05.138548 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22fc5292-74b4-4a90-9be2-e7c82090213a req-2b953e54-3689-4b9d-897b-093d07950450 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0480144 Dec 08 11:39:05.191570 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22fc5292-74b4-4a90-9be2-e7c82090213a req-832c490d-6c8a-44b2-973e-4ad6145d8c96 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480301 Dec 08 11:39:06.305424 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13173625-fe99-41d8-9bb1-9735e23040ac req-af8d2361-258f-40c2-8ecb-a3f7a47764dd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:06.306862 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-13173625-fe99-41d8-9bb1-9735e23040ac req-af8d2361-258f-40c2-8ecb-a3f7a47764dd tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0479960 Dec 08 11:39:06.354682 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-13173625-fe99-41d8-9bb1-9735e23040ac req-c05d8c3c-ba8b-432b-b426-589c4b358671 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419879 Dec 08 11:39:06.894978 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:39:07.469784 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7469adc5-119d-4a79-8f0f-f522f8c66e4a req-a9b8ec78-72ed-406f-bdf8-a4b1eef6fd7e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:07.471262 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7469adc5-119d-4a79-8f0f-f522f8c66e4a req-a9b8ec78-72ed-406f-bdf8-a4b1eef6fd7e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0512798 Dec 08 11:39:07.524730 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7469adc5-119d-4a79-8f0f-f522f8c66e4a req-cae95588-6cab-440f-9e49-25253b66f46f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470226 Dec 08 11:39:08.643579 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f2bfaa-e0a9-4969-8ddc-3000786f85b0 req-d0d53954-b1c1-4604-9f53-c28697fb5c2a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:08.645031 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5f2bfaa-e0a9-4969-8ddc-3000786f85b0 req-d0d53954-b1c1-4604-9f53-c28697fb5c2a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0514200 Dec 08 11:39:08.692856 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5f2bfaa-e0a9-4969-8ddc-3000786f85b0 req-e4497b96-6f18-4a8c-bf6a-9364c8896ad4 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413857 Dec 08 11:39:09.804035 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e786ba76-4bf6-4627-b988-dcbc34d9cca6 req-453e56a6-fc4f-45f0-b020-505d3869d4b9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:09.805500 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e786ba76-4bf6-4627-b988-dcbc34d9cca6 req-453e56a6-fc4f-45f0-b020-505d3869d4b9 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0481105 Dec 08 11:39:09.853851 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e786ba76-4bf6-4627-b988-dcbc34d9cca6 req-969e970b-8ab8-4845-aa4c-5c04cb760569 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424325 Dec 08 11:39:10.965373 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640fa5b3-bd2d-41e0-9d95-374b5747f6e9 req-0bb54538-2ce7-431a-a943-6f491638a976 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:10.966853 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-640fa5b3-bd2d-41e0-9d95-374b5747f6e9 req-0bb54538-2ce7-431a-a943-6f491638a976 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0484924 Dec 08 11:39:11.019198 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-640fa5b3-bd2d-41e0-9d95-374b5747f6e9 req-209e3234-26bd-4fb8-8ba1-554c6902cf1c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466518 Dec 08 11:39:12.130804 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e6339e0-5e1d-4277-8360-e17e966be931 req-a9c63190-008e-4bd5-9c31-db07e8d3b59d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:12.132771 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8e6339e0-5e1d-4277-8360-e17e966be931 req-a9c63190-008e-4bd5-9c31-db07e8d3b59d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0475533 Dec 08 11:39:12.180659 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8e6339e0-5e1d-4277-8360-e17e966be931 req-0631d0b5-2250-47b5-b407-d1dbfeb569b4 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419779 Dec 08 11:39:13.299457 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d51f234e-6e52-48f3-93ac-a948ab3f38cc req-0363539b-8773-440d-8469-b8f250ee474f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:13.300928 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d51f234e-6e52-48f3-93ac-a948ab3f38cc req-0363539b-8773-440d-8469-b8f250ee474f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0480194 Dec 08 11:39:13.349508 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d51f234e-6e52-48f3-93ac-a948ab3f38cc req-27692fe0-c267-4f8d-8293-c13dd9809861 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418043 Dec 08 11:39:14.466401 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b463397-da0b-475b-915a-0adfdaf76b17 req-cd854879-37a1-42cf-90c2-4d637d52d7ae tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:14.467894 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9b463397-da0b-475b-915a-0adfdaf76b17 req-cd854879-37a1-42cf-90c2-4d637d52d7ae tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0523210 Dec 08 11:39:14.515898 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9b463397-da0b-475b-915a-0adfdaf76b17 req-edfe5e00-b3c9-49d9-b633-a345bd001f7c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420225 Dec 08 11:39:15.192032 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5506cebd-f0a4-467d-964c-e95c70349128 req-623c0ab6-1f7c-4245-9691-a371b52ce3c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:15.193542 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5506cebd-f0a4-467d-964c-e95c70349128 req-623c0ab6-1f7c-4245-9691-a371b52ce3c1 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=23027f58b51142389f64405702a0fcd3&device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 1098 time: 0.0417233 Dec 08 11:39:15.290115 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5506cebd-f0a4-467d-964c-e95c70349128 req-243233c2-b8bd-4e18-989c-092dd9789dcc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:15.291607 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5506cebd-f0a4-467d-964c-e95c70349128 req-243233c2-b8bd-4e18-989c-092dd9789dcc service neutron] 10.222.0.61 "GET /v2.0/networks?id=55a129bc-8ce3-4aac-98fb-64f16c4a4949 HTTP/1.1" status: 200 len: 910 time: 0.0868485 Dec 08 11:39:15.357726 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5506cebd-f0a4-467d-964c-e95c70349128 req-4149e130-fef7-4b67-8baa-7f1c08e2b85e service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=79e98205-d459-4886-827e-71b058999e30 HTTP/1.1" status: 200 len: 1001 time: 0.0584383 Dec 08 11:39:15.406286 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5506cebd-f0a4-467d-964c-e95c70349128 req-48eb8302-d562-4975-ad91-6c490939c71a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:15.407730 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5506cebd-f0a4-467d-964c-e95c70349128 req-48eb8302-d562-4975-ad91-6c490939c71a service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59081569-032b-42c0-afce-26c79ceb7aac HTTP/1.1" status: 200 len: 848 time: 0.0424132 Dec 08 11:39:15.458275 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5506cebd-f0a4-467d-964c-e95c70349128 req-b93c31c0-b880-4a28-bd50-5635a2457cd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:15.459729 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5506cebd-f0a4-467d-964c-e95c70349128 req-b93c31c0-b880-4a28-bd50-5635a2457cd8 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=55a129bc-8ce3-4aac-98fb-64f16c4a4949&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0421250 Dec 08 11:39:15.550301 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5506cebd-f0a4-467d-964c-e95c70349128 req-20d99833-2275-40d4-9363-903ed1a4ced4 service neutron] 10.222.0.61 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0809460 Dec 08 11:39:15.672327 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6929fe-a4eb-490f-80cc-34b29f7173d5 req-6015ee1a-314d-458b-9e94-bdfc0541a7b6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:15.673767 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-af6929fe-a4eb-490f-80cc-34b29f7173d5 req-6015ee1a-314d-458b-9e94-bdfc0541a7b6 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0703025 Dec 08 11:39:15.690323 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5506cebd-f0a4-467d-964c-e95c70349128 req-aea996c8-ccc0-49fd-b842-857041e611c1 service neutron] 10.222.0.61 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1310701 Dec 08 11:39:15.728844 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-af6929fe-a4eb-490f-80cc-34b29f7173d5 req-7e2a92ea-016e-4882-baf0-f446d37a4e94 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0477924 Dec 08 11:39:16.841118 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c1f70e-9306-4b37-9e87-0ed6fb68db68 req-38d5ed5a-5208-4892-9d95-753981a0a3f4 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:16.842591 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4c1f70e-9306-4b37-9e87-0ed6fb68db68 req-38d5ed5a-5208-4892-9d95-753981a0a3f4 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0477166 Dec 08 11:39:16.894044 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c4c1f70e-9306-4b37-9e87-0ed6fb68db68 req-41633252-2877-42e7-9846-e586a8c67b84 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455418 Dec 08 11:39:17.662027 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:18.012093 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-788b1dac-d52b-4fde-a568-ab8a126784a5 req-8ef3ba99-fd67-482e-b9e7-b94a3049f01f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:18.013605 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-788b1dac-d52b-4fde-a568-ab8a126784a5 req-8ef3ba99-fd67-482e-b9e7-b94a3049f01f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0497422 Dec 08 11:39:18.063195 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-788b1dac-d52b-4fde-a568-ab8a126784a5 req-48417f2b-0bfe-471b-994b-3ac6596184ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434096 Dec 08 11:39:18.220289 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [req-181ff8ad-d9c5-483e-a660-ab6e8ca47cfc req-a4e724f9-feda-4eb8-978b-89aacb7f7384 service neutron] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102318) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:39:18.221316 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-181ff8ad-d9c5-483e-a660-ab6e8ca47cfc req-a4e724f9-feda-4eb8-978b-89aacb7f7384 service neutron] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0920997 Dec 08 11:39:18.370246 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-dd405139-5f2b-45e6-b8f7-20f45969461e service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0679519 Dec 08 11:39:18.385984 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3779313-e784-4b42-be3c-d47d49cad374 req-edb82ccd-3d3b-42fc-899b-5b37f1684022 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:18.387409 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e3779313-e784-4b42-be3c-d47d49cad374 req-edb82ccd-3d3b-42fc-899b-5b37f1684022 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0611565 Dec 08 11:39:18.438012 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e3779313-e784-4b42-be3c-d47d49cad374 req-2c99411d-a658-41d8-ae12-6453c227324e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438247 Dec 08 11:39:19.550822 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3640bcda-9a20-4731-92db-d559a9badec8 req-524166cc-48b6-4750-a358-26312ce37948 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:19.552262 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3640bcda-9a20-4731-92db-d559a9badec8 req-524166cc-48b6-4750-a358-26312ce37948 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0477107 Dec 08 11:39:19.599423 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3640bcda-9a20-4731-92db-d559a9badec8 req-339614d6-5670-4b8d-ac1f-6e15695758bb tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405278 Dec 08 11:39:19.672272 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-556f06b7-9ffd-4247-ace0-7ace1253e4f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:19.673792 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-556f06b7-9ffd-4247-ace0-7ace1253e4f3 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1&tenant_id=23027f58b51142389f64405702a0fcd3 HTTP/1.1" status: 200 len: 1098 time: 0.0401266 Dec 08 11:39:19.740428 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-263ac2ba-be03-4f16-a04d-9a29748e8030 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:19.742529 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-263ac2ba-be03-4f16-a04d-9a29748e8030 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=23027f58b51142389f64405702a0fcd3&device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 1098 time: 0.0438139 Dec 08 11:39:19.796649 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 79e98205-d459-4886-827e-71b058999e30 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:39:19.832601 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-abdaa406-e888-43c5-a8f6-676f93c5b89d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:19.834152 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-abdaa406-e888-43c5-a8f6-676f93c5b89d service neutron] 10.222.0.61 "GET /v2.0/networks?id=55a129bc-8ce3-4aac-98fb-64f16c4a4949 HTTP/1.1" status: 200 len: 910 time: 0.0822690 Dec 08 11:39:19.873318 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:19.895164 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '79e98205-d459-4886-827e-71b058999e30'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:39:19.897394 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0b5dac37-db62-4722-a17a-60a9934e650a" -d '{"events": [{"server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "name": "network-vif-unplugged", "status": "completed", "tag": "79e98205-d459-4886-827e-71b058999e30"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:39:19.904533 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-3b2bf808-846c-4541-ae6b-941c4dff0390 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=79e98205-d459-4886-827e-71b058999e30 HTTP/1.1" status: 200 len: 1001 time: 0.0619371 Dec 08 11:39:19.914918 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 79e98205-d459-4886-827e-71b058999e30, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=79e98205-d459-4886-827e-71b058999e30,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:39:19.920637 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:19.944889 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Wed, 08 Dec 2021 11:39:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-103c87d9-7d6d-4e4a-bba0-4758e197ed5e x-openstack-request-id: req-103c87d9-7d6d-4e4a-bba0-4758e197ed5e {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:39:19.945205 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "name": "network-vif-unplugged", "status": "completed", "tag": "79e98205-d459-4886-827e-71b058999e30", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:39:19.945483 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-103c87d9-7d6d-4e4a-bba0-4758e197ed5e {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:39:19.946439 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '79e98205-d459-4886-827e-71b058999e30', 'code': 200} Dec 08 11:39:19.965882 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-acd74374-29d4-4b96-9f0b-d01e87016f1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:19.967426 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-acd74374-29d4-4b96-9f0b-d01e87016f1a service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59081569-032b-42c0-afce-26c79ceb7aac HTTP/1.1" status: 200 len: 848 time: 0.0541084 Dec 08 11:39:19.972670 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=79e98205-d459-4886-827e-71b058999e30,revision_number=6']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:20.017809 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-ce234961-20c5-4246-be6c-7e29de1a3c85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:20.019978 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-ce234961-20c5-4246-be6c-7e29de1a3c85 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=55a129bc-8ce3-4aac-98fb-64f16c4a4949&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0439134 Dec 08 11:39:20.114983 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-f434eeda-68ae-4635-a104-4a671c43ee5f service neutron] 10.222.0.61 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860193 Dec 08 11:39:20.204655 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-252e498a-bce6-4941-9080-43c8b9ee5f03 req-7afca4a6-9f90-49d8-8c3f-2932fa5a3059 service neutron] 10.222.0.61 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813689 Dec 08 11:39:20.720689 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9ba158e-c85a-4400-86ac-65e034fdfb35 req-92246789-2e11-4d33-9889-6e154e0b1904 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:20.722118 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b9ba158e-c85a-4400-86ac-65e034fdfb35 req-92246789-2e11-4d33-9889-6e154e0b1904 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0519905 Dec 08 11:39:20.774795 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b9ba158e-c85a-4400-86ac-65e034fdfb35 req-4204df8a-3971-40be-ae6a-bb9693f32979 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461357 Dec 08 11:39:21.886372 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d65a6521-52f0-475d-9ce8-667e957efa45 req-ea13d91c-e36f-4a66-bbc4-5df9e4bf4729 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:21.887839 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d65a6521-52f0-475d-9ce8-667e957efa45 req-ea13d91c-e36f-4a66-bbc4-5df9e4bf4729 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0474842 Dec 08 11:39:21.937683 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d65a6521-52f0-475d-9ce8-667e957efa45 req-313ce3c3-c746-431a-9548-056cb157d43e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436912 Dec 08 11:39:22.470158 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b264495f-c8ff-4184-a282-d6829a2c7a69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:23.049403 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd354ed5-2e29-4ec5-a699-75ffcd028f0a req-8c2ef7b5-06e3-4484-8475-94a846425768 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:23.050875 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd354ed5-2e29-4ec5-a699-75ffcd028f0a req-8c2ef7b5-06e3-4484-8475-94a846425768 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0482805 Dec 08 11:39:23.098255 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd354ed5-2e29-4ec5-a699-75ffcd028f0a req-d454d090-44eb-44f9-a28a-0b10cfcba52d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409400 Dec 08 11:39:24.220878 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e828583-223e-45ee-99de-95a43be68a08 req-400b32e4-15a5-4321-af97-71ee6a37a4b2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:24.222393 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0e828583-223e-45ee-99de-95a43be68a08 req-400b32e4-15a5-4321-af97-71ee6a37a4b2 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0549738 Dec 08 11:39:24.270678 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0e828583-223e-45ee-99de-95a43be68a08 req-dde4179a-0302-49bb-9ee1-545d4386517a tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414422 Dec 08 11:39:24.703392 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-72e5a778-6304-4f00-8fa9-9e59829975c4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:25.383590 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7387e60-ceb7-4a11-bc36-1efbf0d6b770 req-9d8d5a5e-32d0-4fdb-80f4-b9b85dc5195d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:25.384945 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f7387e60-ceb7-4a11-bc36-1efbf0d6b770 req-9d8d5a5e-32d0-4fdb-80f4-b9b85dc5195d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0470340 Dec 08 11:39:25.432092 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f7387e60-ceb7-4a11-bc36-1efbf0d6b770 req-1b44b00a-6c71-45c5-a961-ce73e130c77c tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410092 Dec 08 11:39:25.794032 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:26.543106 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42490e33-e5d8-4db2-9222-a2d01e9cbd1c req-1f98148f-9569-4b11-9313-3ba75727bf9d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:26.544558 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-42490e33-e5d8-4db2-9222-a2d01e9cbd1c req-1f98148f-9569-4b11-9313-3ba75727bf9d tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0474460 Dec 08 11:39:26.595130 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-42490e33-e5d8-4db2-9222-a2d01e9cbd1c req-447a29ea-0c22-4262-af61-da42f0c50600 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447562 Dec 08 11:39:27.138011 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ce666df-59c2-4891-b29f-d734096048e1 req-c79733f0-1569-4fb7-898c-6464baa43419 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:27.143785 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9ce666df-59c2-4891-b29f-d734096048e1 req-c79733f0-1569-4fb7-898c-6464baa43419 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0487206 Dec 08 11:39:27.153212 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:27.189865 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9ce666df-59c2-4891-b29f-d734096048e1 req-5109a843-f5b5-4973-8a20-85c1e5e42cd1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414810 Dec 08 11:39:27.342870 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-840a02f7-50f9-4902-b432-2d6c1cd244f3 req-f1488b2a-e791-4f08-96dd-bb898f879ae2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:27.344353 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-840a02f7-50f9-4902-b432-2d6c1cd244f3 req-f1488b2a-e791-4f08-96dd-bb898f879ae2 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 1096 time: 0.0399461 Dec 08 11:39:27.393556 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-840a02f7-50f9-4902-b432-2d6c1cd244f3 req-edff620d-bd40-4764-8cbc-19799cc17ef7 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408914 Dec 08 11:39:27.717919 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36c15ec9-2301-4ff5-9c78-5257037cb8c2 req-ced373de-f80f-4dda-b966-2e70a054db00 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:27.719393 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-36c15ec9-2301-4ff5-9c78-5257037cb8c2 req-ced373de-f80f-4dda-b966-2e70a054db00 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.0546989 Dec 08 11:39:27.770742 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-36c15ec9-2301-4ff5-9c78-5257037cb8c2 req-f41aeada-a36f-4134-977c-0a69874e20d0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453870 Dec 08 11:39:28.157064 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:28.305262 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a43df6-6485-419a-a56b-161522819d73 req-c39535ca-af30-4b3b-b1f4-6f09257d376f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:28.306715 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b7a43df6-6485-419a-a56b-161522819d73 req-c39535ca-af30-4b3b-b1f4-6f09257d376f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0478792 Dec 08 11:39:28.352555 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b7a43df6-6485-419a-a56b-161522819d73 req-ae7ac669-8dd3-44de-8b99-adadc6f1e996 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399175 Dec 08 11:39:28.762273 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-5d9f7b20-ebe1-459b-bc6b-40f8177e1469 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:28.763708 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-5d9f7b20-ebe1-459b-bc6b-40f8177e1469 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.61 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0506036 Dec 08 11:39:28.898293 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Deleting port 731fa8a4-e27d-4561-a86e-aa21c87548e7 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:39:28.898630 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:29.216466 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-982f696d-72d7-492a-b3e9-ae0329d1c548 req-7c38d8da-b15f-421d-8d18-6644cb850940 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:29.218018 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-982f696d-72d7-492a-b3e9-ae0329d1c548 req-7c38d8da-b15f-421d-8d18-6644cb850940 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 943 time: 0.3783097 Dec 08 11:39:29.295283 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] For port 731fa8a4-e27d-4561-a86e-aa21c87548e7, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=731fa8a4-e27d-4561-a86e-aa21c87548e7,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:39:29.295645 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:29.301039 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-982f696d-72d7-492a-b3e9-ae0329d1c548 req-56f7ba8d-d3d1-4668-9b90-bece387fe93f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0763705 Dec 08 11:39:29.494143 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:29.494506 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:29.494819 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Floating IP fd0a7f40-f924-4e9c-bc63-9482b537d307 disassociated. External IP: 172.27.2.124, port: 731fa8a4-e27d-4561-a86e-aa21c87548e7. Dec 08 11:39:29.495158 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling delete_port for 731fa8a4-e27d-4561-a86e-aa21c87548e7 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:39:29.516012 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f6301d3-e109-4004-af4d-ac00ce18be8f req-bab55400-f4e1-427b-9768-4a478a07535d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:29.517497 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6f6301d3-e109-4004-af4d-ac00ce18be8f req-bab55400-f4e1-427b-9768-4a478a07535d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538 HTTP/1.1" status: 200 len: 945 time: 0.0770874 Dec 08 11:39:29.613536 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6f6301d3-e109-4004-af4d-ac00ce18be8f req-cf000270-f6e0-4f64-988f-4c81f51fa67e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=ec46dd19-fbbc-4297-9312-9548f39f5aef&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0650392 Dec 08 11:39:29.672022 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:29.699693 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event deleted for resources: {'Port': ['ID=731fa8a4-e27d-4561-a86e-aa21c87548e7,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:29.810855 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Router e1280faa-8f3b-40a4-8270-5461288df246 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:39:29.835591 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 79e98205-d459-4886-827e-71b058999e30 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:39:29.918384 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:39:29.932137 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-144effc6-91dd-4780-ac90-c3a64fafad33 None None] Sync routers for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:39:29.957542 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] No DVR routers for this DVR port 731fa8a4-e27d-4561-a86e-aa21c87548e7 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:39:29.960781 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:29.964154 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c1abbaea-bc9c-466f-a90c-22e1b6f1d1be req-c4b92b90-6fcd-40f2-a7a7-317421bf376c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.61 "DELETE /v2.0/ports/731fa8a4-e27d-4561-a86e-aa21c87548e7 HTTP/1.1" status: 204 len: 173 time: 1.1910062 Dec 08 11:39:29.964613 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538', 'name': 'network-vif-deleted', 'tag': '731fa8a4-e27d-4561-a86e-aa21c87548e7'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:39:29.966946 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ebf5d62d-66b8-427c-8a56-cfc0dbd470e0" -d '{"events": [{"server_uuid": "6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538", "name": "network-vif-deleted", "tag": "731fa8a4-e27d-4561-a86e-aa21c87548e7"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:39:30.011352 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:39:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d8e4f02-25ce-4838-ae62-709d690269bf x-openstack-request-id: req-9d8e4f02-25ce-4838-ae62-709d690269bf {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:39:30.011654 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538", "name": "network-vif-deleted", "tag": "731fa8a4-e27d-4561-a86e-aa21c87548e7", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:39:30.011907 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-9d8e4f02-25ce-4838-ae62-709d690269bf {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:39:30.012440 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6e6c9ef2-4e56-4fa2-a3c1-e94bbe907538', 'name': 'network-vif-deleted', 'tag': '731fa8a4-e27d-4561-a86e-aa21c87548e7', 'status': 'completed', 'code': 200} Dec 08 11:39:30.073626 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 79e98205-d459-4886-827e-71b058999e30, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=79e98205-d459-4886-827e-71b058999e30,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:39:30.090495 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '79e98205-d459-4886-827e-71b058999e30', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'port_id': '79e98205-d459-4886-827e-71b058999e30', 'mac_address': 'fa:16:3e:dd:98:56', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 262, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '59081569-032b-42c0-afce-26c79ceb7aac', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:39:30.096101 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-144effc6-91dd-4780-ac90-c3a64fafad33 None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:39:30.096737 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-144effc6-91dd-4780-ac90-c3a64fafad33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:39:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:39:30.209101 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:30.230435 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 79e98205-d459-4886-827e-71b058999e30 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:39:30.260764 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-144effc6-91dd-4780-ac90-c3a64fafad33 None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:39:30.263395 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 79e98205-d459-4886-827e-71b058999e30, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=79e98205-d459-4886-827e-71b058999e30,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:39:30.290963 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:30.411459 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=79e98205-d459-4886-827e-71b058999e30,revision_number=7']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:30.417208 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85c4b2e6-4899-4013-b784-d4894ef5dc71 req-4a320617-3c73-4b40-ac78-eef84b92a075 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:30.418720 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85c4b2e6-4899-4013-b784-d4894ef5dc71 req-4a320617-3c73-4b40-ac78-eef84b92a075 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 944 time: 0.0486569 Dec 08 11:39:30.469505 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85c4b2e6-4899-4013-b784-d4894ef5dc71 req-30b49eed-4ab0-429c-b65c-85f6fbba04b0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443628 Dec 08 11:39:30.507033 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-144effc6-91dd-4780-ac90-c3a64fafad33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:20Z', 'revision_number': 5, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:39:30.534546 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-144effc6-91dd-4780-ac90-c3a64fafad33 None None] Checking router: e1280faa-8f3b-40a4-8270-5461288df246 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:39:30.544459 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-144effc6-91dd-4780-ac90-c3a64fafad33 None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:39:30.545085 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-144effc6-91dd-4780-ac90-c3a64fafad33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:39:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:39:30.636978 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['79e98205-d459-4886-827e-71b058999e30'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:39:30.690919 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-144effc6-91dd-4780-ac90-c3a64fafad33 None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:39:30.722010 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58040) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:39:30.783436 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e81c40ed-5e21-4d41-997b-e5cda7bf656e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:30.809192 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e81c40ed-5e21-4d41-997b-e5cda7bf656e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:30.863894 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e81c40ed-5e21-4d41-997b-e5cda7bf656e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:30.867486 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e81c40ed-5e21-4d41-997b-e5cda7bf656e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:30.873180 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58042) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:39:30.873720 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-e81c40ed-5e21-4d41-997b-e5cda7bf656e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "DELETE /v2.0/security-groups/ec46dd19-fbbc-4297-9312-9548f39f5aef HTTP/1.1" status: 204 len: 168 time: 0.1491230 Dec 08 11:39:30.883023 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e81c40ed-5e21-4d41-997b-e5cda7bf656e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec46dd19-fbbc-4297-9312-9548f39f5aef,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:30.913458 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.api.v2.resource [None req-a67e348b-215a-41d5-8f86-c0c42b5744d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] show failed (client error): The resource could not be found. Dec 08 11:39:30.917664 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-a67e348b-215a-41d5-8f86-c0c42b5744d4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups/ec46dd19-fbbc-4297-9312-9548f39f5aef HTTP/1.1" status: 404 len: 347 time: 0.0447667 Dec 08 11:39:30.918992 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58046) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:39:31.043486 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-144effc6-91dd-4780-ac90-c3a64fafad33 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:20Z', 'revision_number': 5, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:39:31.061183 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Deleting port d46e8300-fa4a-42b8-955d-4026377ba7a0 {{(pid=102317) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:39:31.061523 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:31.079834 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-144effc6-91dd-4780-ac90-c3a64fafad33 None None] The sync data for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi is: [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:20Z', 'revision_number': 5, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:39:31.156773 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:31.157110 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:31.169426 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling delete_port for d46e8300-fa4a-42b8-955d-4026377ba7a0 owned by network:floatingip {{(pid=102317) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:39:31.311836 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:31.326782 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79bb5596-204a-43d5-8368-a28405dd4505 None None] New status for floating IP fd0a7f40-f924-4e9c-bc63-9482b537d307: DOWN {{(pid=102320) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:39:31.339471 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event deleted for resources: {'Port': ['ID=d46e8300-fa4a-42b8-955d-4026377ba7a0,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:31.363578 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:39:31.363925 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:39:31.364278 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:39:31.364613 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:39:31.364947 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:39:31.365301 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:39:31.365630 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:39:31.366512 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:39:31.366837 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:39:31.367164 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:39:31.367491 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:39:31.367811 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:39:31.368129 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:39:31.409441 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:31.411980 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:31.413678 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-b3a9ece3-a8a6-4c43-827a-f7eb8aab195b tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "DELETE /v2.0/floatingips/fd0a7f40-f924-4e9c-bc63-9482b537d307 HTTP/1.1" status: 204 len: 168 time: 0.4937520 Dec 08 11:39:31.773170 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58050) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:39:31.777697 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-c323da18-7f7d-402b-b334-499178e0663c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Request body: {'security_group': {'name': 'tempest-securitygroup--118614222', 'description': 'tempest-description--532422381'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:39:31.798211 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c323da18-7f7d-402b-b334-499178e0663c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:31.862707 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c323da18-7f7d-402b-b334-499178e0663c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:31.866719 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c323da18-7f7d-402b-b334-499178e0663c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:31.869057 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 79e98205-d459-4886-827e-71b058999e30 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:39:31.894686 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c323da18-7f7d-402b-b334-499178e0663c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:31.898566 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-c323da18-7f7d-402b-b334-499178e0663c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.1217115 Dec 08 11:39:31.899049 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58052) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:39:31.900209 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c323da18-7f7d-402b-b334-499178e0663c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d942334b-e776-48d7-bdd4-04c6cf5975fa,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:31.906410 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-01b3a937-0b1d-400a-b9c4-d4cc9df07405 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Request body: {'security_group_rule': {'security_group_id': 'd942334b-e776-48d7-bdd4-04c6cf5975fa', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:39:31.918629 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 79e98205-d459-4886-827e-71b058999e30 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:39:31.919004 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:31.935344 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01b3a937-0b1d-400a-b9c4-d4cc9df07405 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:31.980496 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01b3a937-0b1d-400a-b9c4-d4cc9df07405 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:31.985620 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01b3a937-0b1d-400a-b9c4-d4cc9df07405 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.000695 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.004664 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01b3a937-0b1d-400a-b9c4-d4cc9df07405 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=724b2e51-d613-4172-8fac-d82db535695b,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:32.014495 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01b3a937-0b1d-400a-b9c4-d4cc9df07405 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.017810 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-01b3a937-0b1d-400a-b9c4-d4cc9df07405 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1163061 Dec 08 11:39:32.018440 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58056) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:39:32.022945 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-6c5acc18-8a69-4507-8b2b-e5878e126310 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Request body: {'security_group_rule': {'security_group_id': 'd942334b-e776-48d7-bdd4-04c6cf5975fa', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:39:32.030220 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79e98205-d459-4886-827e-71b058999e30'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:39:32.032408 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3dd510a9-002d-4aa8-8cf8-d8581ca385ff" -d '{"events": [{"server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "name": "network-vif-plugged", "status": "completed", "tag": "79e98205-d459-4886-827e-71b058999e30"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:39:32.047838 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 79e98205-d459-4886-827e-71b058999e30, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=79e98205-d459-4886-827e-71b058999e30,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:39:32.051733 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.052728 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 731fa8a4-e27d-4561-a86e-aa21c87548e7 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:39:32.054130 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c5acc18-8a69-4507-8b2b-e5878e126310 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.087798 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:39:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-521b46af-4f90-4429-a6c1-de89a494619b x-openstack-request-id: req-521b46af-4f90-4429-a6c1-de89a494619b {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:39:32.088092 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "name": "network-vif-plugged", "status": "completed", "tag": "79e98205-d459-4886-827e-71b058999e30", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:39:32.088348 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-521b46af-4f90-4429-a6c1-de89a494619b {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:39:32.088740 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '79e98205-d459-4886-827e-71b058999e30', 'code': 200} Dec 08 11:39:32.107132 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 731fa8a4-e27d-4561-a86e-aa21c87548e7 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:39:32.107480 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 731fa8a4-e27d-4561-a86e-aa21c87548e7 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:39:32.118244 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c5acc18-8a69-4507-8b2b-e5878e126310 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.122534 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c5acc18-8a69-4507-8b2b-e5878e126310 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.131024 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=79e98205-d459-4886-827e-71b058999e30,revision_number=8']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:32.140341 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c5acc18-8a69-4507-8b2b-e5878e126310 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ac52f977-c29d-4e20-9bf9-29ae45274cd8,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:32.148437 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c5acc18-8a69-4507-8b2b-e5878e126310 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.149635 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-6c5acc18-8a69-4507-8b2b-e5878e126310 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1301906 Dec 08 11:39:32.152723 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58060) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:39:32.156964 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Request body: {'floatingip': {'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:39:32.178568 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.277104 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.379137 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Allocated IP 172.27.2.130 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/8705750a-043c-420a-8fe5-569519383376) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:39:32.476426 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.510426 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.549182 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:39:32.554281 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:39:32.556802 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:39:32.583401 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event updated for resources: {'Port': ['ID=8705750a-043c-420a-8fe5-569519383376,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:32.644187 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.676028 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.822427 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.826549 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5648421'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.893075 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event updated for resources: {'Port': ['ID=8705750a-043c-420a-8fe5-569519383376,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:32.906883 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.922644 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:32.924126 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-bbf3d3a1-3d50-42cf-9ba1-7ef807de22c8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.7701552 Dec 08 11:39:33.114298 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-f55f6894-5efd-4808-b3e3-e3f6128d5fd8 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?name=tempest-securitygroup--118614222&fields=id&tenant_id=9c60094b48d34489b46e92ae73d7e33a HTTP/1.1" status: 200 len: 267 time: 0.0435295 Dec 08 11:39:33.225902 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ba19f7ef-2f4b-47e3-afd0-680068895811 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:33.227338 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ba19f7ef-2f4b-47e3-afd0-680068895811 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/networks?id=185aeb08-41ef-4fae-a420-33296f710850 HTTP/1.1" status: 200 len: 810 time: 0.1056347 Dec 08 11:39:33.241962 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-de330694-95c8-40a8-9c86-26fd16406f6d tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/quotas/9c60094b48d34489b46e92ae73d7e33a HTTP/1.1" status: 200 len: 375 time: 0.0087738 Dec 08 11:39:33.291173 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-9b62270f-a694-4ec5-a18a-8931fea85355 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=9c60094b48d34489b46e92ae73d7e33a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0441008 Dec 08 11:39:33.386707 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-c5dded86-960c-4e27-ba2e-92ba6a326ddf service neutron] 10.222.0.66 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837274 Dec 08 11:39:33.473779 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-90ce4608-36a1-4a3b-af9f-955b2a3af8a6 service neutron] 10.222.0.66 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809500 Dec 08 11:39:33.632555 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b4f604b7-5f6e-4678-8751-e08754ec5bee req-83f20ca1-8449-4d05-a92e-711fa6a4dbe7 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 210 time: 0.0262802 Dec 08 11:39:34.550839 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-6752c10b-80bf-45b0-b812-f61c143a888c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:34.552288 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-6752c10b-80bf-45b0-b812-f61c143a888c tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.61 "GET /v2.0/networks?id=185aeb08-41ef-4fae-a420-33296f710850 HTTP/1.1" status: 200 len: 810 time: 0.1030321 Dec 08 11:39:34.621099 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-09a3cec6-dbea-4c8e-a432-06fe05307df4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9c60094b48d34489b46e92ae73d7e33a HTTP/1.1" status: 200 len: 379 time: 0.0582807 Dec 08 11:39:34.633260 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ce5ed2b4-0754-425c-8463-94749ca7f706 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Request body: {'port': {'device_id': '7f2f2abb-3bae-48d7-a02d-420f509114ca', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'admin_state_up': True, 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'security_groups': ['d942334b-e776-48d7-bdd4-04c6cf5975fa']}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:39:34.735123 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d4f262b-93ef-4a03-a58f-77dadff88658 req-f479eee5-7851-4724-a965-ff1ca0a55c44 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 210 time: 0.0351126 Dec 08 11:39:34.763564 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ce5ed2b4-0754-425c-8463-94749ca7f706 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Made reservation on behalf of 9c60094b48d34489b46e92ae73d7e33a for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:39:34.767559 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ce5ed2b4-0754-425c-8463-94749ca7f706 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:34.893713 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ce5ed2b4-0754-425c-8463-94749ca7f706 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Allocated IP 172.20.0.10 (185aeb08-41ef-4fae-a420-33296f710850/40a584f7-ce77-4d89-87c2-4f3f589c6700/973b8088-0638-45a6-9fe0-acffa26314d2) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:39:35.023487 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ce5ed2b4-0754-425c-8463-94749ca7f706 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:35.056240 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ce5ed2b4-0754-425c-8463-94749ca7f706 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:35.098488 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ce5ed2b4-0754-425c-8463-94749ca7f706 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Network 185aeb08-41ef-4fae-a420-33296f710850 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:39:35.102035 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ce5ed2b4-0754-425c-8463-94749ca7f706 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:39:35.107663 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ce5ed2b4-0754-425c-8463-94749ca7f706 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:39:35.135122 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce5ed2b4-0754-425c-8463-94749ca7f706 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event updated for resources: {'Port': ['ID=973b8088-0638-45a6-9fe0-acffa26314d2,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:35.161337 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ce5ed2b4-0754-425c-8463-94749ca7f706 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:35.161948 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ce5ed2b4-0754-425c-8463-94749ca7f706 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:35.179202 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-ce5ed2b4-0754-425c-8463-94749ca7f706 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5494537 Dec 08 11:39:35.201865 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Request body: {'port': {'device_id': '7f2f2abb-3bae-48d7-a02d-420f509114ca', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:39:35.257255 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:35.280662 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361b1b-6390-4f0d-bb66-77ad64967cbc None None] Provisioning complete for port 973b8088-0638-45a6-9fe0-acffa26314d2 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:39:35.281211 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361b1b-6390-4f0d-bb66-77ad64967cbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:35.315243 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361b1b-6390-4f0d-bb66-77ad64967cbc None None] Port 973b8088-0638-45a6-9fe0-acffa26314d2 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:39:35.516488 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 973b8088-0638-45a6-9fe0-acffa26314d2 {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:39:35.525135 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:35.538416 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Transition to ACTIVE for port object 973b8088-0638-45a6-9fe0-acffa26314d2 will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:39:35.542640 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:35.595969 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Pushing event updated for resources: {'Port': ['ID=973b8088-0638-45a6-9fe0-acffa26314d2,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:35.659934 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Attempting to bind port 973b8088-0638-45a6-9fe0-acffa26314d2 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:39:35.660278 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Attempting to bind port 973b8088-0638-45a6-9fe0-acffa26314d2 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:39:35.660605 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Attempting to bind port 973b8088-0638-45a6-9fe0-acffa26314d2 on network 185aeb08-41ef-4fae-a420-33296f710850 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:39:35.666012 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Port 973b8088-0638-45a6-9fe0-acffa26314d2 on network 185aeb08-41ef-4fae-a420-33296f710850 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:39:35.666331 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Attempting to bind port 973b8088-0638-45a6-9fe0-acffa26314d2 on network 185aeb08-41ef-4fae-a420-33296f710850 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:39:35.671617 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 39, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:39:35.671951 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Checking segment: {'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:39:35.672330 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Bound using segment: {'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:39:35.672748 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Bound port: 973b8088-0638-45a6-9fe0-acffa26314d2, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '432df489-4b9c-40d9-bda0-90c4bebb3b27', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 296, 'network_id': '185aeb08-41ef-4fae-a420-33296f710850'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:39:35.673096 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:35.747708 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] For port 973b8088-0638-45a6-9fe0-acffa26314d2, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:39:35.750889 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] For port 973b8088-0638-45a6-9fe0-acffa26314d2, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=973b8088-0638-45a6-9fe0-acffa26314d2,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:39:35.754231 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:35.789452 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:35.790002 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:35.791517 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] 10.222.0.61 "PUT /v2.0/ports/973b8088-0638-45a6-9fe0-acffa26314d2 HTTP/1.1" status: 200 len: 1094 time: 0.5939305 Dec 08 11:39:35.791987 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7f2f2abb-3bae-48d7-a02d-420f509114ca', 'tag': '973b8088-0638-45a6-9fe0-acffa26314d2'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:39:35.794807 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd18f5ab-4c45-4130-9926-87b454688d28" -d '{"events": [{"name": "network-changed", "server_uuid": "7f2f2abb-3bae-48d7-a02d-420f509114ca", "tag": "973b8088-0638-45a6-9fe0-acffa26314d2"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:39:35.845468 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:39:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-278f0e13-6007-41dd-8ac0-2d72090e390c x-openstack-request-id: req-278f0e13-6007-41dd-8ac0-2d72090e390c {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:39:35.845763 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7f2f2abb-3bae-48d7-a02d-420f509114ca", "tag": "973b8088-0638-45a6-9fe0-acffa26314d2", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:39:35.846026 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-278f0e13-6007-41dd-8ac0-2d72090e390c {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:39:35.846426 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7f2f2abb-3bae-48d7-a02d-420f509114ca', 'tag': '973b8088-0638-45a6-9fe0-acffa26314d2', 'status': 'completed', 'code': 200} Dec 08 11:39:35.874129 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d3c026e-84cd-495d-a5ed-64747ed76c78 service neutron] Pushing event updated for resources: {'Port': ['ID=973b8088-0638-45a6-9fe0-acffa26314d2,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:35.920696 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa24c265-3039-4a21-b975-7d15518ca828 req-412925aa-566a-434e-9d35-97cad77d0443 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:35.922300 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-aa24c265-3039-4a21-b975-7d15518ca828 req-412925aa-566a-434e-9d35-97cad77d0443 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 944 time: 0.1057770 Dec 08 11:39:35.928690 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-af473bd5-a8b2-4303-b1d2-f7d12f35a3af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:35.930967 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-af473bd5-a8b2-4303-b1d2-f7d12f35a3af service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=9c60094b48d34489b46e92ae73d7e33a&device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 1097 time: 0.0836835 Dec 08 11:39:35.985046 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-e051398b-f7ea-4061-b318-c3d6e1171133 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=973b8088-0638-45a6-9fe0-acffa26314d2 HTTP/1.1" status: 200 len: 217 time: 0.0397482 Dec 08 11:39:36.031372 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-aa24c265-3039-4a21-b975-7d15518ca828 req-958f331d-955a-4ce9-9627-3c69349f9a93 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=d942334b-e776-48d7-bdd4-04c6cf5975fa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0995159 Dec 08 11:39:36.047995 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-b4e0a3da-02d4-4c25-a9ea-58a2d9612167 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:36.047995 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-b4e0a3da-02d4-4c25-a9ea-58a2d9612167 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=40a584f7-ce77-4d89-87c2-4f3f589c6700 HTTP/1.1" status: 200 len: 849 time: 0.0543406 Dec 08 11:39:36.096437 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-4d59f791-cd20-440a-a178-dbcec0e0e0df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:36.097949 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-4d59f791-cd20-440a-a178-dbcec0e0e0df service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=185aeb08-41ef-4fae-a420-33296f710850&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0440745 Dec 08 11:39:36.184899 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-113f8064-0431-4026-8326-de3477c6fd0d service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0796957 Dec 08 11:39:36.280533 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cbe08eb3-3c05-4d9a-b38f-8b6e90ee3dfa req-3d61860a-e8ff-4192-9624-9ce5a5a6bcfe service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876358 Dec 08 11:39:36.375312 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-6ddaeb04-325b-4094-afb5-89a6805cecb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:36.376796 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-6ddaeb04-325b-4094-afb5-89a6805cecb7 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=9c60094b48d34489b46e92ae73d7e33a&device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 1097 time: 0.0468216 Dec 08 11:39:36.464733 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-965d8c2d-ab30-4b7d-9370-4ab3c857526a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:36.466242 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-965d8c2d-ab30-4b7d-9370-4ab3c857526a service neutron] 10.222.0.61 "GET /v2.0/networks?id=185aeb08-41ef-4fae-a420-33296f710850 HTTP/1.1" status: 200 len: 911 time: 0.0823424 Dec 08 11:39:36.510552 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-e08842d7-4d5b-46ac-bb00-6177bd906425 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=973b8088-0638-45a6-9fe0-acffa26314d2 HTTP/1.1" status: 200 len: 217 time: 0.0360525 Dec 08 11:39:36.557317 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-30c9c292-5995-4702-bd0f-43d5f8feb740 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:36.558695 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-30c9c292-5995-4702-bd0f-43d5f8feb740 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=40a584f7-ce77-4d89-87c2-4f3f589c6700 HTTP/1.1" status: 200 len: 849 time: 0.0408511 Dec 08 11:39:36.618220 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-b14a6aba-ead3-4f31-866e-5a5d381bc235 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:36.619578 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-b14a6aba-ead3-4f31-866e-5a5d381bc235 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=185aeb08-41ef-4fae-a420-33296f710850&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0405965 Dec 08 11:39:36.711767 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-989d7040-fb41-44c3-a466-2e7baf9f3e16 service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828125 Dec 08 11:39:36.797966 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd18f5ab-4c45-4130-9926-87b454688d28 req-a696f3ba-8d2c-410f-a095-41fd9387689c service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0786076 Dec 08 11:39:37.149205 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba8dc129-b582-4a28-98f5-3179deb6919e req-ca05e327-ba08-4790-8ccb-6d00accf35e2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:37.150644 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ba8dc129-b582-4a28-98f5-3179deb6919e req-ca05e327-ba08-4790-8ccb-6d00accf35e2 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 944 time: 0.0523269 Dec 08 11:39:37.196391 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ba8dc129-b582-4a28-98f5-3179deb6919e req-25415fcd-023d-4519-9342-17c645440d02 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=d942334b-e776-48d7-bdd4-04c6cf5975fa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398428 Dec 08 11:39:38.314585 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf82fcd6-05de-4a48-8f28-26228d0166d4 req-5e26be84-c8c9-4597-98f4-fdc0555bec05 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:38.316076 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf82fcd6-05de-4a48-8f28-26228d0166d4 req-5e26be84-c8c9-4597-98f4-fdc0555bec05 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 944 time: 0.0546787 Dec 08 11:39:38.361578 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf82fcd6-05de-4a48-8f28-26228d0166d4 req-d13d8c30-b713-4c5f-94ee-bc96c70d10f6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=d942334b-e776-48d7-bdd4-04c6cf5975fa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395672 Dec 08 11:39:39.475206 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4fc8121-80bf-4842-917a-331c381809d6 req-030fff53-b8f8-4f66-9d1f-545df4033ff9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:39.476659 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d4fc8121-80bf-4842-917a-331c381809d6 req-030fff53-b8f8-4f66-9d1f-545df4033ff9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 944 time: 0.0492957 Dec 08 11:39:39.525645 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d4fc8121-80bf-4842-917a-331c381809d6 req-5bed152e-8c50-4565-854c-003cbcf09cd5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=d942334b-e776-48d7-bdd4-04c6cf5975fa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429194 Dec 08 11:39:39.902808 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 973b8088-0638-45a6-9fe0-acffa26314d2 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:39:39.996854 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 973b8088-0638-45a6-9fe0-acffa26314d2, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=973b8088-0638-45a6-9fe0-acffa26314d2,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:39:40.007723 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '973b8088-0638-45a6-9fe0-acffa26314d2', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'port_id': '973b8088-0638-45a6-9fe0-acffa26314d2', 'mac_address': 'fa:16:3e:99:eb:99', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 296, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:39:40.044704 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:40.057874 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 973b8088-0638-45a6-9fe0-acffa26314d2 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:39:40.076182 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 973b8088-0638-45a6-9fe0-acffa26314d2, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=973b8088-0638-45a6-9fe0-acffa26314d2,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:39:40.079640 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:40.129687 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=973b8088-0638-45a6-9fe0-acffa26314d2,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:40.411829 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['973b8088-0638-45a6-9fe0-acffa26314d2'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:39:40.637735 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bfdfdab-679e-4f5b-b137-5d255aefcfa3 req-061d8e01-f2a1-4aac-80de-33c92f710fef tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:40.639376 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4bfdfdab-679e-4f5b-b137-5d255aefcfa3 req-061d8e01-f2a1-4aac-80de-33c92f710fef tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 945 time: 0.0478163 Dec 08 11:39:40.685390 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4bfdfdab-679e-4f5b-b137-5d255aefcfa3 req-3715c15d-08ed-4844-9b1f-3e71902eefa9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=d942334b-e776-48d7-bdd4-04c6cf5975fa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402842 Dec 08 11:39:41.797703 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9e36188-afae-49fd-bc48-829586e56b3c req-2614c2e7-09a5-4103-bc39-8409b13767a4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:41.799147 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b9e36188-afae-49fd-bc48-829586e56b3c req-2614c2e7-09a5-4103-bc39-8409b13767a4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 945 time: 0.0484850 Dec 08 11:39:41.845075 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b9e36188-afae-49fd-bc48-829586e56b3c req-4d591296-9044-4c26-a30c-405ef76bcd98 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=d942334b-e776-48d7-bdd4-04c6cf5975fa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401216 Dec 08 11:39:41.919289 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 973b8088-0638-45a6-9fe0-acffa26314d2 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:39:42.093396 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 973b8088-0638-45a6-9fe0-acffa26314d2 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:39:42.097142 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 973b8088-0638-45a6-9fe0-acffa26314d2 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:39:42.097542 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:42.172673 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:42.194767 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7f2f2abb-3bae-48d7-a02d-420f509114ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '973b8088-0638-45a6-9fe0-acffa26314d2'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:39:42.197569 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2b64e221-2be7-4914-b5ad-566349c48bab" -d '{"events": [{"server_uuid": "7f2f2abb-3bae-48d7-a02d-420f509114ca", "name": "network-vif-plugged", "status": "completed", "tag": "973b8088-0638-45a6-9fe0-acffa26314d2"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:39:42.210498 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 973b8088-0638-45a6-9fe0-acffa26314d2, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=973b8088-0638-45a6-9fe0-acffa26314d2,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:39:42.215506 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:42.238185 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:39:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-97cc21aa-e850-48bf-8ad3-4d1252ff4e96 x-openstack-request-id: req-97cc21aa-e850-48bf-8ad3-4d1252ff4e96 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:39:42.238476 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7f2f2abb-3bae-48d7-a02d-420f509114ca", "name": "network-vif-plugged", "status": "completed", "tag": "973b8088-0638-45a6-9fe0-acffa26314d2", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:39:42.238728 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-97cc21aa-e850-48bf-8ad3-4d1252ff4e96 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:39:42.239106 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7f2f2abb-3bae-48d7-a02d-420f509114ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '973b8088-0638-45a6-9fe0-acffa26314d2', 'code': 200} Dec 08 11:39:42.265687 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=973b8088-0638-45a6-9fe0-acffa26314d2,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:39:42.413879 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd24f3e-36aa-4096-8621-bcc9b01caf5e req-07dd3955-6ea1-41bc-ba13-dd82973ec037 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:42.415954 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ddd24f3e-36aa-4096-8621-bcc9b01caf5e req-07dd3955-6ea1-41bc-ba13-dd82973ec037 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 1099 time: 0.0432074 Dec 08 11:39:42.461998 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ddd24f3e-36aa-4096-8621-bcc9b01caf5e req-2dad23ad-5615-4d2c-b49e-20f7ae357722 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=d942334b-e776-48d7-bdd4-04c6cf5975fa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0365963 Dec 08 11:39:42.959934 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d13cf230-d1df-4ffe-9935-c446dabb7ba4 req-002a2a1e-6589-48bd-9fcc-67c5828b302f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:42.962025 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d13cf230-d1df-4ffe-9935-c446dabb7ba4 req-002a2a1e-6589-48bd-9fcc-67c5828b302f tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 946 time: 0.0475221 Dec 08 11:39:43.006118 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d13cf230-d1df-4ffe-9935-c446dabb7ba4 req-03fc718c-b800-44cd-ac87-d1962f2771b5 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=d942334b-e776-48d7-bdd4-04c6cf5975fa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0384305 Dec 08 11:39:43.894015 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:39:44.124186 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d23229cf-7e17-40f2-a8c5-79c8fcde9d62 req-6d538122-b05d-4fbb-8d64-5f0116eef106 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:44.125658 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d23229cf-7e17-40f2-a8c5-79c8fcde9d62 req-6d538122-b05d-4fbb-8d64-5f0116eef106 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 946 time: 0.0518589 Dec 08 11:39:44.171947 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d23229cf-7e17-40f2-a8c5-79c8fcde9d62 req-5564e412-ba91-4bb7-a37d-8adce5d32b47 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=d942334b-e776-48d7-bdd4-04c6cf5975fa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0401008 Dec 08 11:39:44.291308 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15c67e16-739f-4c65-91c6-528f8e6d3023 req-023fd90d-166d-4f78-8e5c-78b1a9f69ad6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:44.292759 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-15c67e16-739f-4c65-91c6-528f8e6d3023 req-023fd90d-166d-4f78-8e5c-78b1a9f69ad6 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 946 time: 0.0479052 Dec 08 11:39:44.301172 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58134) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:39:44.306155 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-200fdd37-3ce7-4937-9962-051f29671a37 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Request body: {'floatingip': {'port_id': '973b8088-0638-45a6-9fe0-acffa26314d2'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:39:44.344164 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-200fdd37-3ce7-4937-9962-051f29671a37 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:44.970635 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.db.resource_extend [None req-200fdd37-3ce7-4937-9962-051f29671a37 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] It took 0.29 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 08 11:39:45.018965 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-200fdd37-3ce7-4937-9962-051f29671a37 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:45.023182 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-200fdd37-3ce7-4937-9962-051f29671a37 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:45.119944 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [None req-200fdd37-3ce7-4937-9962-051f29671a37 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Floating IP e2179aba-a80b-4ecc-a7cd-65324ecfe007 associated. External IP: 172.27.2.130, port: 973b8088-0638-45a6-9fe0-acffa26314d2. Dec 08 11:39:45.325785 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-200fdd37-3ce7-4937-9962-051f29671a37 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Router e1280faa-8f3b-40a4-8270-5461288df246 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:39:45.431371 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-200fdd37-3ce7-4937-9962-051f29671a37 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:39:45.436256 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-200fdd37-3ce7-4937-9962-051f29671a37 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:45.441843 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cc4f8d2-6311-4f63-8208-dc386d7ff474 None None] Sync routers for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:39:45.451548 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cc4f8d2-6311-4f63-8208-dc386d7ff474 None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:39:45.452169 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-0cc4f8d2-6311-4f63-8208-dc386d7ff474 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:39:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:39:45.465229 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-200fdd37-3ce7-4937-9962-051f29671a37 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "PUT /v2.0/floatingips/e2179aba-a80b-4ecc-a7cd-65324ecfe007 HTTP/1.1" status: 200 len: 992 time: 1.1604452 Dec 08 11:39:45.465229 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7f2f2abb-3bae-48d7-a02d-420f509114ca', 'tag': '973b8088-0638-45a6-9fe0-acffa26314d2'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:39:45.465583 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc" -d '{"events": [{"name": "network-changed", "server_uuid": "7f2f2abb-3bae-48d7-a02d-420f509114ca", "tag": "973b8088-0638-45a6-9fe0-acffa26314d2"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:39:45.501984 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:39:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8649c6b6-3faa-41a2-bcaa-88b37503ab30 x-openstack-request-id: req-8649c6b6-3faa-41a2-bcaa-88b37503ab30 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:39:45.502276 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7f2f2abb-3bae-48d7-a02d-420f509114ca", "tag": "973b8088-0638-45a6-9fe0-acffa26314d2", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:39:45.502529 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-8649c6b6-3faa-41a2-bcaa-88b37503ab30 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:39:45.502931 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7f2f2abb-3bae-48d7-a02d-420f509114ca', 'tag': '973b8088-0638-45a6-9fe0-acffa26314d2', 'status': 'completed', 'code': 200} Dec 08 11:39:45.568488 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-0cc4f8d2-6311-4f63-8208-dc386d7ff474 None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:39:45.571421 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-7344bf4d-57d8-4d9b-9676-a48f57ed768a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:45.572970 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-7344bf4d-57d8-4d9b-9676-a48f57ed768a service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=9c60094b48d34489b46e92ae73d7e33a&device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 1099 time: 0.0430954 Dec 08 11:39:45.667192 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-c3d24230-374d-43fa-854e-3a2066de865e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:45.668662 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-c3d24230-374d-43fa-854e-3a2066de865e service neutron] 10.222.0.61 "GET /v2.0/networks?id=185aeb08-41ef-4fae-a420-33296f710850 HTTP/1.1" status: 200 len: 911 time: 0.0868249 Dec 08 11:39:45.737405 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-22c93f65-ed1f-4bac-97c9-99842e07c9a6 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=973b8088-0638-45a6-9fe0-acffa26314d2 HTTP/1.1" status: 200 len: 1000 time: 0.0588863 Dec 08 11:39:45.795449 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-dcb250a1-fbd6-435b-81dd-bce0e7930e78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:45.796796 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-dcb250a1-fbd6-435b-81dd-bce0e7930e78 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=40a584f7-ce77-4d89-87c2-4f3f589c6700 HTTP/1.1" status: 200 len: 849 time: 0.0473351 Dec 08 11:39:45.796931 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-0cc4f8d2-6311-4f63-8208-dc386d7ff474 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'e2179aba-a80b-4ecc-a7cd-65324ecfe007', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'floating_ip_address': '172.27.2.130', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'port_id': '973b8088-0638-45a6-9fe0-acffa26314d2', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 543, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'mac_address': 'fa:16:3e:99:eb:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7f2f2abb-3bae-48d7-a02d-420f509114ca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:39:32Z', 'updated_at': '2021-12-08T11:39:44Z', 'revision_number': 1, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:20Z', 'revision_number': 5, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:39:45.826475 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cc4f8d2-6311-4f63-8208-dc386d7ff474 None None] Checking router: e1280faa-8f3b-40a4-8270-5461288df246 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:39:45.834727 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0cc4f8d2-6311-4f63-8208-dc386d7ff474 None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:39:45.835324 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-0cc4f8d2-6311-4f63-8208-dc386d7ff474 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:39:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:39:45.842747 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-2b94e11f-a328-4ffb-86ac-d9d0fd182b74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:39:45.844278 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-2b94e11f-a328-4ffb-86ac-d9d0fd182b74 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=185aeb08-41ef-4fae-a420-33296f710850&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0398932 Dec 08 11:39:45.934735 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-a4a88fe0-cda5-4e69-b21f-c7b2b24721ae service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832751 Dec 08 11:39:45.939168 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-0cc4f8d2-6311-4f63-8208-dc386d7ff474 None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:39:46.028267 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6bee2667-8a5a-4fb4-84a9-f7f17d1034fc req-2b7d4b30-fbb8-4652-880d-e2135645ed5e service neutron] 10.222.0.61 "GET /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852926 Dec 08 11:39:46.157536 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-0cc4f8d2-6311-4f63-8208-dc386d7ff474 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'e2179aba-a80b-4ecc-a7cd-65324ecfe007', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'floating_ip_address': '172.27.2.130', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'port_id': '973b8088-0638-45a6-9fe0-acffa26314d2', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 543, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'mac_address': 'fa:16:3e:99:eb:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7f2f2abb-3bae-48d7-a02d-420f509114ca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:39:32Z', 'updated_at': '2021-12-08T11:39:44Z', 'revision_number': 1, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:20Z', 'revision_number': 5, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:39:46.187379 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0cc4f8d2-6311-4f63-8208-dc386d7ff474 None None] The sync data for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi is: [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'e2179aba-a80b-4ecc-a7cd-65324ecfe007', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'floating_ip_address': '172.27.2.130', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'port_id': '973b8088-0638-45a6-9fe0-acffa26314d2', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 543, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'mac_address': 'fa:16:3e:99:eb:99', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7f2f2abb-3bae-48d7-a02d-420f509114ca', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:39:32Z', 'updated_at': '2021-12-08T11:39:44Z', 'revision_number': 1, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:20Z', 'revision_number': 5, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:39:46.362919 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3c9d820-3d7f-4eeb-99ca-2e1cc43c9082 None None] New status for floating IP e2179aba-a80b-4ecc-a7cd-65324ecfe007: ACTIVE {{(pid=102320) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:39:47.659043 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:52.471638 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2c41257d-1a63-48b8-aaf3-e84785798d05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:54.704757 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-8c278ff9-5dd6-458f-a0ac-99569ad6ebbe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:55.797307 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:57.156395 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:39:58.159492 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:14.707430 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eb7a4610-0570-4a31-83e1-4af73cfe8f75 req-533b8638-cd02-4ec9-a8fb-ca94450d77c0 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0385818 Dec 08 11:40:14.801028 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb7a4610-0570-4a31-83e1-4af73cfe8f75 req-8ee90f75-0838-4f0e-ac3d-5122f2a8883c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:14.802527 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eb7a4610-0570-4a31-83e1-4af73cfe8f75 req-8ee90f75-0838-4f0e-ac3d-5122f2a8883c service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=23027f58b51142389f64405702a0fcd3&device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 1098 time: 0.0407672 Dec 08 11:40:14.907885 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb7a4610-0570-4a31-83e1-4af73cfe8f75 req-7c38a823-35d5-41c8-a1c9-5d540f662c5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:14.909379 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eb7a4610-0570-4a31-83e1-4af73cfe8f75 req-7c38a823-35d5-41c8-a1c9-5d540f662c5b service neutron] 10.222.0.61 "GET /v2.0/networks?id=55a129bc-8ce3-4aac-98fb-64f16c4a4949 HTTP/1.1" status: 200 len: 910 time: 0.0868709 Dec 08 11:40:14.981351 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eb7a4610-0570-4a31-83e1-4af73cfe8f75 req-223d502f-01ab-4fbb-bb7c-c260cb3f9757 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=79e98205-d459-4886-827e-71b058999e30 HTTP/1.1" status: 200 len: 1001 time: 0.0584190 Dec 08 11:40:15.033931 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb7a4610-0570-4a31-83e1-4af73cfe8f75 req-61ce1dc2-1c89-485a-b527-90dd548b24af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:15.035337 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eb7a4610-0570-4a31-83e1-4af73cfe8f75 req-61ce1dc2-1c89-485a-b527-90dd548b24af service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59081569-032b-42c0-afce-26c79ceb7aac HTTP/1.1" status: 200 len: 848 time: 0.0465927 Dec 08 11:40:15.080432 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb7a4610-0570-4a31-83e1-4af73cfe8f75 req-f9140ca8-6036-4a23-8246-fdb057e9fc64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:15.081923 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eb7a4610-0570-4a31-83e1-4af73cfe8f75 req-f9140ca8-6036-4a23-8246-fdb057e9fc64 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=55a129bc-8ce3-4aac-98fb-64f16c4a4949&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0384197 Dec 08 11:40:15.169625 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eb7a4610-0570-4a31-83e1-4af73cfe8f75 req-2cc7e84d-6cdb-4540-a2ae-91b4461f9cf0 service neutron] 10.222.0.61 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0803113 Dec 08 11:40:15.261300 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eb7a4610-0570-4a31-83e1-4af73cfe8f75 req-4671a958-3b00-4499-a08b-a1b4fa80a2d9 service neutron] 10.222.0.61 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0844741 Dec 08 11:40:17.667132 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:20.893129 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:40:21.727610 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85fdcaf2-67de-40bf-b60f-801bbe31b433 req-4ba7afb4-4b6c-45a2-94c5-c9086bdfaa84 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:21.729106 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85fdcaf2-67de-40bf-b60f-801bbe31b433 req-4ba7afb4-4b6c-45a2-94c5-c9086bdfaa84 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0513661 Dec 08 11:40:21.775958 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-85fdcaf2-67de-40bf-b60f-801bbe31b433 req-87083956-551d-43e6-8ff4-139c92871b0b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409825 Dec 08 11:40:22.473139 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-94675ce6-9dbb-4ba6-85d6-31974ab63d19 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:22.897244 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ca77f0-1f50-49e8-9a5f-cb97f541d0f3 req-40a2f7d4-0082-4774-b775-5078ac625064 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:22.898705 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f6ca77f0-1f50-49e8-9a5f-cb97f541d0f3 req-40a2f7d4-0082-4774-b775-5078ac625064 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0523684 Dec 08 11:40:22.943893 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f6ca77f0-1f50-49e8-9a5f-cb97f541d0f3 req-75b8442c-7207-42d6-a0a5-e7996b14d97f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393431 Dec 08 11:40:24.061047 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d4933a-535e-4617-8cae-000a312fb011 req-dcbdffe7-3be1-419b-aa75-6f24b13576a7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:24.062645 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20d4933a-535e-4617-8cae-000a312fb011 req-dcbdffe7-3be1-419b-aa75-6f24b13576a7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0486269 Dec 08 11:40:24.109833 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-20d4933a-535e-4617-8cae-000a312fb011 req-ccc4d95c-908a-4723-888e-6dc5b42ce454 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412745 Dec 08 11:40:24.706792 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-ca412675-5049-4b9b-8c55-febdf590c0ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:25.228752 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22dbe953-86f5-4fc8-8bb0-5de0f0b7e44f req-13fe31c9-34a3-4ace-b9b8-e462c4634be2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:25.230160 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22dbe953-86f5-4fc8-8bb0-5de0f0b7e44f req-13fe31c9-34a3-4ace-b9b8-e462c4634be2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0492704 Dec 08 11:40:25.280332 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22dbe953-86f5-4fc8-8bb0-5de0f0b7e44f req-f70caa7d-772e-405c-8e5b-59ecd6910a58 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442519 Dec 08 11:40:25.800248 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:26.395800 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da5c4cf8-7606-4974-a54c-3822d40fde48 req-f4ed1d62-35a5-4773-8303-a1e1148fcd48 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:26.397175 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-da5c4cf8-7606-4974-a54c-3822d40fde48 req-f4ed1d62-35a5-4773-8303-a1e1148fcd48 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0479500 Dec 08 11:40:26.448783 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-da5c4cf8-7606-4974-a54c-3822d40fde48 req-2a66a7ec-ba14-4c3c-9477-027d829d101c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452886 Dec 08 11:40:27.155511 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:27.567220 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89069132-89ec-40c8-9206-8e75b47776c5 req-b062d2c4-7066-495b-809d-b9b3f9c4aa33 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:27.569321 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-89069132-89ec-40c8-9206-8e75b47776c5 req-b062d2c4-7066-495b-809d-b9b3f9c4aa33 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0473135 Dec 08 11:40:27.614083 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-89069132-89ec-40c8-9206-8e75b47776c5 req-bfa730fe-54ed-47ee-93bf-451cb4ba3705 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390196 Dec 08 11:40:28.161956 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:28.733537 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e92c81-7dec-48a8-b253-a7a3336bd6b1 req-ca1e076c-d342-4d16-b228-acd78ed91f8b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:28.734900 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-02e92c81-7dec-48a8-b253-a7a3336bd6b1 req-ca1e076c-d342-4d16-b228-acd78ed91f8b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0512059 Dec 08 11:40:28.781168 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-02e92c81-7dec-48a8-b253-a7a3336bd6b1 req-eaf7ca80-8384-44bb-9e3d-7dbb5d993811 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404871 Dec 08 11:40:29.899541 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30cc9281-0ea5-436b-83d5-ce05086387f6 req-c01a5a74-a5ba-48f3-be1d-288e31b7021a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:29.901002 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-30cc9281-0ea5-436b-83d5-ce05086387f6 req-c01a5a74-a5ba-48f3-be1d-288e31b7021a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0486140 Dec 08 11:40:29.947449 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-30cc9281-0ea5-436b-83d5-ce05086387f6 req-33dc4039-1882-43c9-98c7-e23d7fcc2c3d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404897 Dec 08 11:40:31.068778 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f9d17e9-0dcf-48eb-b9f2-e9b164e2ac0a req-f12d356b-d976-450f-9e4d-74459b7f98fc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:31.070279 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0f9d17e9-0dcf-48eb-b9f2-e9b164e2ac0a req-f12d356b-d976-450f-9e4d-74459b7f98fc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0520618 Dec 08 11:40:31.117074 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0f9d17e9-0dcf-48eb-b9f2-e9b164e2ac0a req-ec298266-ab1a-4b55-b4e1-f32fe2d1f5f3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409331 Dec 08 11:40:32.234307 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fa163c-2857-4c73-9de4-8cab4ae2293d req-a68421d5-0720-49df-b3a4-f6d3a5db6f68 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:32.235762 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f6fa163c-2857-4c73-9de4-8cab4ae2293d req-a68421d5-0720-49df-b3a4-f6d3a5db6f68 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0481665 Dec 08 11:40:32.283492 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f6fa163c-2857-4c73-9de4-8cab4ae2293d req-3bc595b1-599a-4555-9073-0e3a0c03a5ab tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417175 Dec 08 11:40:33.400489 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33670374-f303-48fd-8a31-58ef4bd82656 req-a97ec05c-ccb9-4de4-b3af-5826a0c06bed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:33.401992 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33670374-f303-48fd-8a31-58ef4bd82656 req-a97ec05c-ccb9-4de4-b3af-5826a0c06bed tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0484202 Dec 08 11:40:33.454841 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33670374-f303-48fd-8a31-58ef4bd82656 req-e359bb61-fe93-4b8f-a1d8-0fb5505e99a3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469077 Dec 08 11:40:34.571772 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1272bd32-1859-4a8b-8c4f-d739fdd2d01f req-8c992a61-c915-4c6f-958b-e8d9540a989a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:34.573254 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1272bd32-1859-4a8b-8c4f-d739fdd2d01f req-8c992a61-c915-4c6f-958b-e8d9540a989a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0483336 Dec 08 11:40:34.619089 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1272bd32-1859-4a8b-8c4f-d739fdd2d01f req-9380df6c-19b8-471e-923f-257ee9e81491 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399749 Dec 08 11:40:35.739383 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74eac386-76a4-42fe-bfdf-2c13bf6d4c10 req-65cb97a9-5668-4e1d-aeb3-24efb4b90141 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:35.741714 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-74eac386-76a4-42fe-bfdf-2c13bf6d4c10 req-65cb97a9-5668-4e1d-aeb3-24efb4b90141 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0491376 Dec 08 11:40:35.791800 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-74eac386-76a4-42fe-bfdf-2c13bf6d4c10 req-9b3ddd3c-63b0-4172-9ca1-958cd37f5a91 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417557 Dec 08 11:40:36.912787 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67c14805-b8e3-46e6-80c6-5f53f052daf4 req-5c46b767-ad45-455d-bb6c-65589b000969 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:36.914261 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-67c14805-b8e3-46e6-80c6-5f53f052daf4 req-5c46b767-ad45-455d-bb6c-65589b000969 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0518692 Dec 08 11:40:36.958817 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-67c14805-b8e3-46e6-80c6-5f53f052daf4 req-ff959d9e-5e51-4131-ab97-888734b522e8 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387282 Dec 08 11:40:38.076196 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bc1aeb6-f94b-43e7-82cc-8957a53ef7de req-a3ac512e-f643-449b-a61c-3aa407b1c88c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:38.077666 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2bc1aeb6-f94b-43e7-82cc-8957a53ef7de req-a3ac512e-f643-449b-a61c-3aa407b1c88c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0484257 Dec 08 11:40:38.124162 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2bc1aeb6-f94b-43e7-82cc-8957a53ef7de req-4678c7b9-3bc9-4010-aef6-b57d6bc9f07a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405364 Dec 08 11:40:39.242083 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a3a2e0-ec7d-41fa-86f7-3aaff333e8b1 req-186e5bb3-22d4-4fa8-9018-9e862001e8ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:39.243531 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e4a3a2e0-ec7d-41fa-86f7-3aaff333e8b1 req-186e5bb3-22d4-4fa8-9018-9e862001e8ad tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0481961 Dec 08 11:40:39.292719 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e4a3a2e0-ec7d-41fa-86f7-3aaff333e8b1 req-cce0e59f-c397-427b-a813-c538a0af2b8d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433199 Dec 08 11:40:40.227933 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:40:40.318781 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:40:40.333598 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'port_id': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'mac_address': 'fa:16:3e:63:16:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 278, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:40:40.370187 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:40.383372 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:40:40.402209 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:40:40.406160 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:40.410857 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0190d6b5-cbb5-4185-836b-d2093f68606a req-22e997a7-6a58-45fb-88ec-b14d1711674a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:40.413054 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0190d6b5-cbb5-4185-836b-d2093f68606a req-22e997a7-6a58-45fb-88ec-b14d1711674a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0494902 Dec 08 11:40:40.455877 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,revision_number=6']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:40:40.460293 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0190d6b5-cbb5-4185-836b-d2093f68606a req-4ca51382-ef6a-4ad8-a205-96aa3b9856f4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412178 Dec 08 11:40:40.463879 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:40:40.464228 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:40:40.464568 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:40:40.464901 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:40:40.465255 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:40:40.465589 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:40:40.465916 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:40:40.466236 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:40:40.466563 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:40:40.466903 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:40:40.467225 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:40:40.467543 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:40:40.467859 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:40:40.494708 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:40:41.578024 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b59ff18-1150-49e2-ba49-9a808e2dff5c req-0b53bd26-c9cf-490b-b7b7-9f24ad4379dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:41.579497 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b59ff18-1150-49e2-ba49-9a808e2dff5c req-0b53bd26-c9cf-490b-b7b7-9f24ad4379dd tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 945 time: 0.0485504 Dec 08 11:40:41.625786 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b59ff18-1150-49e2-ba49-9a808e2dff5c req-88025e59-2b34-4fdd-aee2-2c81d00523fb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397470 Dec 08 11:40:42.238525 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:40:42.286214 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:40:42.286587 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:42.363361 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:42.384362 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:40:42.386620 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a00b6dfa-2333-4bc0-99f9-6d0116a4ea57" -d '{"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-plugged", "status": "completed", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:40:42.399864 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:40:42.404178 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:42.432754 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:40:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e185735c-e705-4b9f-b529-8a955e56aa7d x-openstack-request-id: req-e185735c-e705-4b9f-b529-8a955e56aa7d {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:40:42.433047 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-plugged", "status": "completed", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:40:42.433394 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-e185735c-e705-4b9f-b529-8a955e56aa7d {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:40:42.433783 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'code': 200} Dec 08 11:40:42.457863 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,revision_number=7']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:40:42.748802 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71846e5c-f2ba-4a63-8783-c03375c5aa3d req-de4dd0f7-0e3d-4d00-a02d-d8d27ba372c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:42.750275 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-71846e5c-f2ba-4a63-8783-c03375c5aa3d req-de4dd0f7-0e3d-4d00-a02d-d8d27ba372c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0509353 Dec 08 11:40:42.796548 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-71846e5c-f2ba-4a63-8783-c03375c5aa3d req-fdfbee52-cee1-483d-8884-a3ee0b1f1161 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398881 Dec 08 11:40:43.914192 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47e59d28-fc9a-43c9-8ace-af25f083a5b1 req-ee233210-f204-4658-a571-a7727f5a71e7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:43.915655 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-47e59d28-fc9a-43c9-8ace-af25f083a5b1 req-ee233210-f204-4658-a571-a7727f5a71e7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0483954 Dec 08 11:40:43.962182 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-47e59d28-fc9a-43c9-8ace-af25f083a5b1 req-c411a5d2-1756-44f0-9b88-93a0cf70beba tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404773 Dec 08 11:40:45.104457 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1449fae-aead-40e1-bee2-ff629877eb8f req-bf642521-e390-40c5-8006-adb8f5e8628a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:45.106196 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f1449fae-aead-40e1-bee2-ff629877eb8f req-bf642521-e390-40c5-8006-adb8f5e8628a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0680494 Dec 08 11:40:45.161043 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f1449fae-aead-40e1-bee2-ff629877eb8f req-a2920501-4c38-46a3-8e3e-c740c929de85 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0486720 Dec 08 11:40:46.298819 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27314fe6-22fb-4fab-af78-8652fecde4a1 req-0c8e8cd2-0ce3-4dd0-a129-488e225dd5b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:46.301114 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-27314fe6-22fb-4fab-af78-8652fecde4a1 req-0c8e8cd2-0ce3-4dd0-a129-488e225dd5b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0523601 Dec 08 11:40:46.350188 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-27314fe6-22fb-4fab-af78-8652fecde4a1 req-c1fc156a-bd7f-4585-a7cc-0b01dfe5a003 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422838 Dec 08 11:40:47.478224 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b09a615a-589d-451d-abfb-fbe96273cb93 req-53006bca-4f3d-490f-b227-b809e4c30ba7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:47.479689 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b09a615a-589d-451d-abfb-fbe96273cb93 req-53006bca-4f3d-490f-b227-b809e4c30ba7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0557172 Dec 08 11:40:47.578449 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b09a615a-589d-451d-abfb-fbe96273cb93 req-d1b41408-8af4-4353-a114-4a4401d8005d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0732846 Dec 08 11:40:47.673100 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:48.676577 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7764f744-8f49-458c-b84a-d973394156d7 req-5f5f16b1-8af8-46c8-a5c8-b33202061e64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:48.685463 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7764f744-8f49-458c-b84a-d973394156d7 req-5f5f16b1-8af8-46c8-a5c8-b33202061e64 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0564444 Dec 08 11:40:48.738692 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7764f744-8f49-458c-b84a-d973394156d7 req-f0cc0e65-ffa9-492b-9698-03ace1388927 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0536041 Dec 08 11:40:49.864158 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c23b368a-ba9a-46a7-affc-ce788c060391 req-3b41d38b-7d7c-4db4-a874-2d3938880ba1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:49.865825 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c23b368a-ba9a-46a7-affc-ce788c060391 req-3b41d38b-7d7c-4db4-a874-2d3938880ba1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0515103 Dec 08 11:40:49.916615 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c23b368a-ba9a-46a7-affc-ce788c060391 req-635be263-a076-46c8-99b9-d544f0148b21 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446861 Dec 08 11:40:51.042736 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafb718d-7a67-4bf7-8ef7-b71d9ca77aeb req-66146446-cb3e-4ca4-b213-589abd78e30f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:51.044230 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cafb718d-7a67-4bf7-8ef7-b71d9ca77aeb req-66146446-cb3e-4ca4-b213-589abd78e30f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0550761 Dec 08 11:40:51.105740 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cafb718d-7a67-4bf7-8ef7-b71d9ca77aeb req-3a61d8d3-588a-4d5c-8569-b72efdbfc58b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0545244 Dec 08 11:40:52.228551 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-712b0565-8e93-4974-a946-a7a5a66e04ab req-32814927-29dc-4ae5-9d8d-23aa21c63c34 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:52.229872 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-712b0565-8e93-4974-a946-a7a5a66e04ab req-32814927-29dc-4ae5-9d8d-23aa21c63c34 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0501549 Dec 08 11:40:52.281997 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-712b0565-8e93-4974-a946-a7a5a66e04ab req-06c64759-0775-4cfb-ad2c-bfb7519ed5dc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441937 Dec 08 11:40:52.486712 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e86c1825-7f64-4a16-872d-5923f4da557a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:53.415626 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43592422-acd5-4b3d-af92-f914aed7beb5 req-3468746e-82c6-4a18-aaaa-3f73e5e11fa2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:53.417279 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-43592422-acd5-4b3d-af92-f914aed7beb5 req-3468746e-82c6-4a18-aaaa-3f73e5e11fa2 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0537248 Dec 08 11:40:53.475862 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-43592422-acd5-4b3d-af92-f914aed7beb5 req-b16ea417-3ba1-44b9-8c38-403617fbd333 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0523283 Dec 08 11:40:54.617235 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0a908fe-3484-433a-bf1e-00b545e135f9 req-efe8386f-eb28-4b58-abd9-ac622a7362ac tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:54.619484 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f0a908fe-3484-433a-bf1e-00b545e135f9 req-efe8386f-eb28-4b58-abd9-ac622a7362ac tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0606880 Dec 08 11:40:54.672033 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f0a908fe-3484-433a-bf1e-00b545e135f9 req-e77b26bb-0172-4599-aac2-6e6d681ebc87 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456798 Dec 08 11:40:54.712259 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-cf3d23da-80f8-4fa7-a5ad-993c1d410caf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:55.798632 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c5ece6-4afe-448a-9653-7d9eae93eacc req-dadda539-92e0-4db1-a7c4-ec04750de435 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:55.800247 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-50c5ece6-4afe-448a-9653-7d9eae93eacc req-dadda539-92e0-4db1-a7c4-ec04750de435 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0559351 Dec 08 11:40:55.804388 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:55.849472 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-50c5ece6-4afe-448a-9653-7d9eae93eacc req-515e8011-957b-4fa5-bc16-8931382617ac tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406768 Dec 08 11:40:55.938421 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9067ed95-1c16-4958-b680-915e47108433 req-1a9f4826-9105-47d2-9f60-0f618875f58c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:55.939875 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9067ed95-1c16-4958-b680-915e47108433 req-1a9f4826-9105-47d2-9f60-0f618875f58c service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 1099 time: 0.0429130 Dec 08 11:40:56.027186 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9067ed95-1c16-4958-b680-915e47108433 req-ac5f39b1-b020-4277-84f6-f9ab59cef8ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:56.028559 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9067ed95-1c16-4958-b680-915e47108433 req-ac5f39b1-b020-4277-84f6-f9ab59cef8ba service neutron] 10.222.0.61 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 917 time: 0.0815086 Dec 08 11:40:56.096637 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9067ed95-1c16-4958-b680-915e47108433 req-d1004f0d-fa22-42da-b886-be40be8ee85b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee HTTP/1.1" status: 200 len: 1001 time: 0.0594914 Dec 08 11:40:56.143934 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9067ed95-1c16-4958-b680-915e47108433 req-3f86829b-eb38-4d42-9726-4c422ff2f721 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:56.145354 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9067ed95-1c16-4958-b680-915e47108433 req-3f86829b-eb38-4d42-9726-4c422ff2f721 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 200 len: 855 time: 0.0419972 Dec 08 11:40:56.191939 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9067ed95-1c16-4958-b680-915e47108433 req-c485e803-2bd9-4295-83ca-3af4d5fb7c22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:56.194031 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9067ed95-1c16-4958-b680-915e47108433 req-c485e803-2bd9-4295-83ca-3af4d5fb7c22 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=fd37a1fc-3614-462b-92a2-b41260c949a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0418949 Dec 08 11:40:56.284026 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9067ed95-1c16-4958-b680-915e47108433 req-748a3c89-7664-430e-9ee7-3506d0e0799f service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822840 Dec 08 11:40:56.369459 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9067ed95-1c16-4958-b680-915e47108433 req-0334fca5-c40e-4498-b990-dd846f9d2413 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0783167 Dec 08 11:40:56.970947 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36a94ef1-fc57-4040-821f-b5bacc0c486a req-5b0b945b-a4e3-41a2-a924-db91bbd94745 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:56.972388 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-36a94ef1-fc57-4040-821f-b5bacc0c486a req-5b0b945b-a4e3-41a2-a924-db91bbd94745 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0517025 Dec 08 11:40:57.017605 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-36a94ef1-fc57-4040-821f-b5bacc0c486a req-ffec1363-e891-4cbc-b86e-3f82e3efd8d0 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392692 Dec 08 11:40:57.157997 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:57.891634 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:40:58.139170 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b844ca0-56ea-45aa-92b8-7aeedc0173cb req-6866eb95-336b-4a57-897d-e20bb22bf702 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:58.140657 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3b844ca0-56ea-45aa-92b8-7aeedc0173cb req-6866eb95-336b-4a57-897d-e20bb22bf702 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 946 time: 0.0511012 Dec 08 11:40:58.166440 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:58.189005 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3b844ca0-56ea-45aa-92b8-7aeedc0173cb req-9572a92d-f30e-4cd9-9183-8f58bdc7935c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420449 Dec 08 11:40:58.331851 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:40:58.405696 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:58.427005 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:40:58.429119 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c97ce9b6-f3e5-4810-9015-85c285831343" -d '{"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-unplugged", "status": "completed", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:40:58.442018 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:40:58.445752 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:40:58.472127 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Wed, 08 Dec 2021 11:40:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-08ab8f9d-3f4b-4576-a78c-87b82f707b22 x-openstack-request-id: req-08ab8f9d-3f4b-4576-a78c-87b82f707b22 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:40:58.472418 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-unplugged", "status": "completed", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:40:58.472697 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-08ab8f9d-3f4b-4576-a78c-87b82f707b22 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:40:58.473085 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'code': 200} Dec 08 11:40:58.495347 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,revision_number=8']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:40:59.310161 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db8f3c7a-f2ef-4df7-9f3c-6f97f1f4b19e req-f41cf37e-9be3-42d6-8550-1cf49aa4d908 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:40:59.311609 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-db8f3c7a-f2ef-4df7-9f3c-6f97f1f4b19e req-f41cf37e-9be3-42d6-8550-1cf49aa4d908 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0473552 Dec 08 11:40:59.360070 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-db8f3c7a-f2ef-4df7-9f3c-6f97f1f4b19e req-05fa8ffc-97fa-40a5-9809-5b709be7226d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425868 Dec 08 11:41:00.217366 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868db9cb-3613-4a07-ae3d-4db51d9dee97 req-41b60a72-1ecc-46e7-a88d-373d6f0e20cb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:00.218840 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-868db9cb-3613-4a07-ae3d-4db51d9dee97 req-41b60a72-1ecc-46e7-a88d-373d6f0e20cb tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0498703 Dec 08 11:41:00.267845 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-868db9cb-3613-4a07-ae3d-4db51d9dee97 req-7b182e8a-25fa-4da4-9fa8-52a6c122d85d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426173 Dec 08 11:41:00.389929 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-5df14a79-6d54-4b75-a2b3-a7b907661550 service neutron] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0806301 Dec 08 11:41:01.153175 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-e25cca3e-56bf-415e-abf0-189aff358a81 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:01.154628 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-e25cca3e-56bf-415e-abf0-189aff358a81 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3&tenant_id=44406e332fd94f1a9dcd704577410a61 HTTP/1.1" status: 200 len: 1097 time: 0.0404258 Dec 08 11:41:01.221663 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-4c0c37fd-411f-45f9-8492-11f2f5f2b777 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:01.223130 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-4c0c37fd-411f-45f9-8492-11f2f5f2b777 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 1097 time: 0.0433691 Dec 08 11:41:01.310723 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-11bf2c93-e5f8-4acd-a912-a263a3573825 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:01.312172 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-11bf2c93-e5f8-4acd-a912-a263a3573825 service neutron] 10.222.0.61 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 917 time: 0.0821915 Dec 08 11:41:01.406794 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-7d0161d9-20fe-4377-b856-b50b4a6cc164 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee HTTP/1.1" status: 200 len: 999 time: 0.0863082 Dec 08 11:41:01.419105 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c29c1610-58c9-4e6c-b1d2-70f9f5ea35e1 req-a8cbb95c-40d5-43fd-9324-ddab2b61a4a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:01.420501 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c29c1610-58c9-4e6c-b1d2-70f9f5ea35e1 req-a8cbb95c-40d5-43fd-9324-ddab2b61a4a1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0627742 Dec 08 11:41:01.488821 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-f2ce7704-f2b0-4319-96e4-a08cb88e70ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:01.490270 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-f2ce7704-f2b0-4319-96e4-a08cb88e70ab service neutron] 10.222.0.61 "GET /v2.0/subnets?id=62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 200 len: 855 time: 0.0689418 Dec 08 11:41:01.515873 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c29c1610-58c9-4e6c-b1d2-70f9f5ea35e1 req-7a5bd264-8851-449b-9a98-14d18bf89c5e tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0862765 Dec 08 11:41:01.543205 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-f9ca99ce-c9ae-4667-8b3a-db1899303920 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:01.544653 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-f9ca99ce-c9ae-4667-8b3a-db1899303920 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=fd37a1fc-3614-462b-92a2-b41260c949a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0468178 Dec 08 11:41:01.629808 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-621d1468-1575-475a-8b95-257a840b4dff service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0779238 Dec 08 11:41:01.719334 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-42baf52f-75fd-474c-bc1b-48686ec91ea0 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815215 Dec 08 11:41:02.638644 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfc68d89-56f1-4127-8da7-f8a19dbf6f76 req-a1eaa9e2-5f68-425a-adfe-848ef8be8221 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:02.640132 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dfc68d89-56f1-4127-8da7-f8a19dbf6f76 req-a1eaa9e2-5f68-425a-adfe-848ef8be8221 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0498812 Dec 08 11:41:02.688262 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dfc68d89-56f1-4127-8da7-f8a19dbf6f76 req-8f03670f-d73c-4cf2-9538-608ee76b9764 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421102 Dec 08 11:41:03.811139 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5db04cdf-f23d-4b2d-a012-763d50b3cc53 req-830b7515-94bc-43bb-b21e-a80370f05d33 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:03.812623 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5db04cdf-f23d-4b2d-a012-763d50b3cc53 req-830b7515-94bc-43bb-b21e-a80370f05d33 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0500872 Dec 08 11:41:03.870510 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5db04cdf-f23d-4b2d-a012-763d50b3cc53 req-c11f9b8e-17f5-468a-b7fe-2f0852281644 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0516045 Dec 08 11:41:04.998676 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a285f3-938a-43a3-8e39-1826499cdd92 req-1f9416e7-51b7-41ae-9851-79c6a222357f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:05.000144 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-65a285f3-938a-43a3-8e39-1826499cdd92 req-1f9416e7-51b7-41ae-9851-79c6a222357f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0499768 Dec 08 11:41:05.048897 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-65a285f3-938a-43a3-8e39-1826499cdd92 req-4b8d2c33-7a61-43b2-a1ac-637ca7daa75d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423949 Dec 08 11:41:06.173603 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b581b37-e78c-48a2-b6bc-cc20aed5cdb4 req-18b2492a-3bef-4e1e-8819-654ea44dfc53 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:06.175191 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b581b37-e78c-48a2-b6bc-cc20aed5cdb4 req-18b2492a-3bef-4e1e-8819-654ea44dfc53 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0505254 Dec 08 11:41:06.221554 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2b581b37-e78c-48a2-b6bc-cc20aed5cdb4 req-1f971c3c-a470-4e91-9e0f-78ca2089d923 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420921 Dec 08 11:41:06.876827 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58582) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:07.040947 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Deleting port 790bdda3-34e1-4e3c-abe5-d7f5a06d21a4 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:07.041321 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:07.116033 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:07.116369 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:07.136047 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling delete_port for 790bdda3-34e1-4e3c-abe5-d7f5a06d21a4 owned by network:floatingip {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:07.291161 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:07.327654 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Pushing event deleted for resources: {'Port': ['ID=790bdda3-34e1-4e3c-abe5-d7f5a06d21a4,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:07.375163 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:07.375511 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:07.375856 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:07.376194 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:07.376524 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:07.376849 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:07.377198 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:07.377524 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:07.377844 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:07.378166 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:07.378489 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:07.378806 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:07.379122 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:07.435548 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbb70b7d-a6c3-4ee4-ae17-f43a55e70756 req-5d260596-67cb-429b-918b-240ea9925c31 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:07.436941 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bbb70b7d-a6c3-4ee4-ae17-f43a55e70756 req-5d260596-67cb-429b-918b-240ea9925c31 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.1221726 Dec 08 11:41:07.439942 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for floatingip, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:07.440284 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Floating IP b9d41293-de2e-446d-89e7-d15c0bf1293e disassociated (deleted). External IP: 172.27.2.165, port: 79e98205-d459-4886-827e-71b058999e30. Dec 08 11:41:07.561526 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bbb70b7d-a6c3-4ee4-ae17-f43a55e70756 req-93fe8caf-1c51-401a-a389-e4bfd657f5c6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1180358 Dec 08 11:41:07.691444 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:41:08.061425 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:41:08.067031 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:08.075875 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53cd5660-fb72-4dd3-a31d-be193a6f31b1 None None] Sync routers for ids ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:41:08.086409 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53cd5660-fb72-4dd3-a31d-be193a6f31b1 None None] Routers {'3a9d62c0-7438-4191-89d6-70be7d9ccc6c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:41:08.087981 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-53cd5660-fb72-4dd3-a31d-be193a6f31b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:40:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:08.095653 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-6998565d-cf84-48a9-8e13-ebea317140ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "DELETE /v2.0/floatingips/b9d41293-de2e-446d-89e7-d15c0bf1293e HTTP/1.1" status: 204 len: 168 time: 1.2176750 Dec 08 11:41:08.096346 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'tag': '79e98205-d459-4886-827e-71b058999e30'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:41:08.098752 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d8fc42d9-4edc-4977-abce-8f5520050f5d" -d '{"events": [{"name": "network-changed", "server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "tag": "79e98205-d459-4886-827e-71b058999e30"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:41:08.200221 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-53cd5660-fb72-4dd3-a31d-be193a6f31b1 None None] Set router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:41:08.287547 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:41:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-16d51638-1668-412a-8015-9f0a5e6c6583 x-openstack-request-id: req-16d51638-1668-412a-8015-9f0a5e6c6583 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:41:08.287847 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "tag": "79e98205-d459-4886-827e-71b058999e30", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:41:08.288104 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-16d51638-1668-412a-8015-9f0a5e6c6583 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:41:08.289017 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'tag': '79e98205-d459-4886-827e-71b058999e30', 'status': 'completed', 'code': 200} Dec 08 11:41:08.419727 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-53cd5660-fb72-4dd3-a31d-be193a6f31b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:44Z', 'revision_number': 4, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port': {'id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:93:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 352, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': 'd5964107-ee0c-4bb0-ad4c-8179b4fa75a2', 'name': '', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'mac_address': 'fa:16:3e:a3:c7:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 353, 'fixed_ips': [{'subnet_id': '59081569-032b-42c0-afce-26c79ceb7aac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:44Z', 'updated_at': '2021-12-08T11:33:50Z', 'revision_number': 5, 'project_id': '23027f58b51142389f64405702a0fcd3', 'subnets': [{'id': '59081569-032b-42c0-afce-26c79ceb7aac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:08.446336 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53cd5660-fb72-4dd3-a31d-be193a6f31b1 None None] Checking router: 3a9d62c0-7438-4191-89d6-70be7d9ccc6c for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:41:08.454605 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a77e2e1c-adc7-4d11-84c3-2335668209ec req-11e92807-14c2-4862-b309-9698a79c55fa tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:08.457049 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53cd5660-fb72-4dd3-a31d-be193a6f31b1 None None] Routers {'3a9d62c0-7438-4191-89d6-70be7d9ccc6c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:41:08.457728 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-53cd5660-fb72-4dd3-a31d-be193a6f31b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:40:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:08.459160 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a77e2e1c-adc7-4d11-84c3-2335668209ec req-11e92807-14c2-4862-b309-9698a79c55fa tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.1165674 Dec 08 11:41:08.518406 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a77e2e1c-adc7-4d11-84c3-2335668209ec req-6a552ba9-14ec-4553-975a-1a30d73e72ad tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0526590 Dec 08 11:41:08.580339 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-53cd5660-fb72-4dd3-a31d-be193a6f31b1 None None] Set router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:41:08.689276 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0218048e-5349-4519-9b29-7977febd9eb1 req-d9a470e3-bf91-4aac-87ec-e12a2b6d6855 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:08.691010 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0218048e-5349-4519-9b29-7977febd9eb1 req-d9a470e3-bf91-4aac-87ec-e12a2b6d6855 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0524857 Dec 08 11:41:08.742755 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0218048e-5349-4519-9b29-7977febd9eb1 req-9af525e0-b843-4214-9eb1-8ebfb4f48f27 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457985 Dec 08 11:41:08.801016 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-53cd5660-fb72-4dd3-a31d-be193a6f31b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:44Z', 'revision_number': 4, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port': {'id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:93:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 352, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': 'd5964107-ee0c-4bb0-ad4c-8179b4fa75a2', 'name': '', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'mac_address': 'fa:16:3e:a3:c7:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 353, 'fixed_ips': [{'subnet_id': '59081569-032b-42c0-afce-26c79ceb7aac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:44Z', 'updated_at': '2021-12-08T11:33:50Z', 'revision_number': 5, 'project_id': '23027f58b51142389f64405702a0fcd3', 'subnets': [{'id': '59081569-032b-42c0-afce-26c79ceb7aac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:08.827979 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53cd5660-fb72-4dd3-a31d-be193a6f31b1 None None] The sync data for ids ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'] in dv-cinder-819778-3-iscsi is: [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:44Z', 'revision_number': 4, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port': {'id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:93:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 352, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': 'd5964107-ee0c-4bb0-ad4c-8179b4fa75a2', 'name': '', 'network_id': '55a129bc-8ce3-4aac-98fb-64f16c4a4949', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'mac_address': 'fa:16:3e:a3:c7:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 353, 'fixed_ips': [{'subnet_id': '59081569-032b-42c0-afce-26c79ceb7aac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:44Z', 'updated_at': '2021-12-08T11:33:50Z', 'revision_number': 5, 'project_id': '23027f58b51142389f64405702a0fcd3', 'subnets': [{'id': '59081569-032b-42c0-afce-26c79ceb7aac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:41:09.057580 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe044747-01f1-4ca2-8e01-526db48402c3 None None] New status for floating IP b9d41293-de2e-446d-89e7-d15c0bf1293e: DOWN {{(pid=102320) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:41:09.636281 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a602aab5-f84d-4ce8-b0eb-ce99b39b5cbe req-a6410ed2-c9cd-40f3-a520-12048e28f360 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:09.638751 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a602aab5-f84d-4ce8-b0eb-ce99b39b5cbe req-a6410ed2-c9cd-40f3-a520-12048e28f360 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0488079 Dec 08 11:41:09.688489 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a602aab5-f84d-4ce8-b0eb-ce99b39b5cbe req-d1500605-44ff-48d4-b5dd-284b106dcca1 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439253 Dec 08 11:41:09.867447 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb9ad07-4e57-436e-a2e7-11bed112be0d req-d0d27207-4689-4867-838b-56ce740b45ac tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:09.868950 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1cb9ad07-4e57-436e-a2e7-11bed112be0d req-d0d27207-4689-4867-838b-56ce740b45ac tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0534127 Dec 08 11:41:09.920600 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1cb9ad07-4e57-436e-a2e7-11bed112be0d req-a3cad16b-461b-42e5-a113-fdcba6cd9a7f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455022 Dec 08 11:41:10.810845 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-939dddb9-85d3-446e-aedf-3cc7cc537a02 req-5e82bf88-c33d-477e-9caf-5bab9ec873a0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:10.813299 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-939dddb9-85d3-446e-aedf-3cc7cc537a02 req-5e82bf88-c33d-477e-9caf-5bab9ec873a0 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0561109 Dec 08 11:41:10.862691 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-939dddb9-85d3-446e-aedf-3cc7cc537a02 req-c211bdb5-c449-49a9-88c7-a48d7a341305 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434079 Dec 08 11:41:11.045813 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7617bd33-f71a-4a39-acb0-e6b504ce04ff req-5a38d944-203b-439f-962d-39bbb77c0a6b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:11.050144 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7617bd33-f71a-4a39-acb0-e6b504ce04ff req-5a38d944-203b-439f-962d-39bbb77c0a6b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0604522 Dec 08 11:41:11.093770 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7617bd33-f71a-4a39-acb0-e6b504ce04ff req-4d86573d-7a29-411b-8c32-285b058455b3 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427361 Dec 08 11:41:11.989854 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-335e100e-b771-444c-90be-6fc96b49f059 req-9907abdd-49aa-434b-b72a-6bbca28e2d56 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:11.991361 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-335e100e-b771-444c-90be-6fc96b49f059 req-9907abdd-49aa-434b-b72a-6bbca28e2d56 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0554514 Dec 08 11:41:12.042313 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-335e100e-b771-444c-90be-6fc96b49f059 req-48dee80f-4890-4bbb-b979-3d0d68532c93 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443742 Dec 08 11:41:12.225482 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e64f2602-97a6-4103-a8a0-e3101e2a299e req-2600e4ed-1e89-4700-91cd-ecb136f887cf tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:12.227626 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e64f2602-97a6-4103-a8a0-e3101e2a299e req-2600e4ed-1e89-4700-91cd-ecb136f887cf tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0580678 Dec 08 11:41:12.274570 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e64f2602-97a6-4103-a8a0-e3101e2a299e req-399ce756-0050-4ce4-bf2d-92640743161f tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407066 Dec 08 11:41:13.172600 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d00ded1-bb25-4ff2-9bd2-f81705e6160e req-6e445186-f79f-4159-b003-3bbcd55a57d8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:13.175256 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0d00ded1-bb25-4ff2-9bd2-f81705e6160e req-6e445186-f79f-4159-b003-3bbcd55a57d8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0608139 Dec 08 11:41:13.232671 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0d00ded1-bb25-4ff2-9bd2-f81705e6160e req-2fa21f94-f52a-4c0b-83cf-6dad0096e19e tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0524929 Dec 08 11:41:13.393345 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3f63c1-e4e6-4a7d-85dd-80ed273201e9 req-dfee8692-1c69-4383-a4eb-f20fefecf1cc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:13.394807 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd3f63c1-e4e6-4a7d-85dd-80ed273201e9 req-dfee8692-1c69-4383-a4eb-f20fefecf1cc tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0488770 Dec 08 11:41:13.441283 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd3f63c1-e4e6-4a7d-85dd-80ed273201e9 req-41df1015-11e1-49ef-9e4e-9360a89f4671 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397699 Dec 08 11:41:14.342940 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4cbc13d-9cd1-46d4-99fc-75f19728b624 req-4841e668-eb4d-4df7-aee6-cb300817a5f4 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:14.344264 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a4cbc13d-9cd1-46d4-99fc-75f19728b624 req-4841e668-eb4d-4df7-aee6-cb300817a5f4 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0464563 Dec 08 11:41:14.392514 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a4cbc13d-9cd1-46d4-99fc-75f19728b624 req-fce097bd-d47c-4719-a700-cd21eb2b28ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424628 Dec 08 11:41:14.563018 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce57b4e-ec73-43bc-9c6b-4acedf67a212 req-805aeac5-52c9-4d6e-9229-dd4ea5bd80f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:14.564444 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cce57b4e-ec73-43bc-9c6b-4acedf67a212 req-805aeac5-52c9-4d6e-9229-dd4ea5bd80f6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0533757 Dec 08 11:41:14.609624 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cce57b4e-ec73-43bc-9c6b-4acedf67a212 req-0a559262-77a2-45cd-ac75-0c15eca57ef7 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392578 Dec 08 11:41:15.504365 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d187a4f-1e1c-44b9-82f3-a8d8c204f4a8 req-be455904-9b83-4fde-90f3-1efa6fcaa639 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:15.505820 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0d187a4f-1e1c-44b9-82f3-a8d8c204f4a8 req-be455904-9b83-4fde-90f3-1efa6fcaa639 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0480521 Dec 08 11:41:15.557741 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0d187a4f-1e1c-44b9-82f3-a8d8c204f4a8 req-14024fd1-24df-4d8d-ae3d-0034ed46050f tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454299 Dec 08 11:41:15.723433 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8256fdb3-f88b-4458-9fd8-876980a40e94 req-332ca72d-cef0-478f-848d-ad56f4f11a1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:15.724764 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8256fdb3-f88b-4458-9fd8-876980a40e94 req-332ca72d-cef0-478f-848d-ad56f4f11a1c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0473285 Dec 08 11:41:15.774217 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8256fdb3-f88b-4458-9fd8-876980a40e94 req-585a40e2-48d3-46d0-bcd0-a71e34d37e23 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429871 Dec 08 11:41:16.341195 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-16804d0f-4b55-44a3-9dc6-6e6482f8f785 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:16.342609 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-16804d0f-4b55-44a3-9dc6-6e6482f8f785 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=23027f58b51142389f64405702a0fcd3&device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 1098 time: 0.0410011 Dec 08 11:41:16.433928 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-d3632145-bc28-4e55-9392-90aea5df9fea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:16.435470 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-d3632145-bc28-4e55-9392-90aea5df9fea service neutron] 10.222.0.61 "GET /v2.0/networks?id=55a129bc-8ce3-4aac-98fb-64f16c4a4949 HTTP/1.1" status: 200 len: 910 time: 0.0834165 Dec 08 11:41:16.484591 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-3201a565-3083-4899-92e9-549596fabf05 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=79e98205-d459-4886-827e-71b058999e30 HTTP/1.1" status: 200 len: 217 time: 0.0395031 Dec 08 11:41:16.535209 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-51a1a9af-dbc8-430a-8051-cec41686c4fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:16.536859 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-51a1a9af-dbc8-430a-8051-cec41686c4fd service neutron] 10.222.0.61 "GET /v2.0/subnets?id=59081569-032b-42c0-afce-26c79ceb7aac HTTP/1.1" status: 200 len: 848 time: 0.0436888 Dec 08 11:41:16.594355 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-d837cb9e-2b6f-4e31-96e5-fe22e33fddc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:16.596241 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-d837cb9e-2b6f-4e31-96e5-fe22e33fddc8 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=55a129bc-8ce3-4aac-98fb-64f16c4a4949&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0507588 Dec 08 11:41:16.735368 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22286cd1-4da8-4699-97a2-e52720c71771 req-1f7b3436-0482-47ac-aee3-8af58e632fa9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:16.736816 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22286cd1-4da8-4699-97a2-e52720c71771 req-1f7b3436-0482-47ac-aee3-8af58e632fa9 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=44406e332fd94f1a9dcd704577410a61&device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 1097 time: 0.0856218 Dec 08 11:41:16.751463 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-d4d6befe-0bd8-4011-ac4d-a139e07d64cc service neutron] 10.222.0.61 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1470876 Dec 08 11:41:16.792641 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b19ae8aa-99e7-49de-9a68-820f6bacc031 req-b0dcfb6d-3960-4d70-80d5-caf904596254 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:16.794070 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b19ae8aa-99e7-49de-9a68-820f6bacc031 req-b0dcfb6d-3960-4d70-80d5-caf904596254 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.1443365 Dec 08 11:41:16.998157 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b19ae8aa-99e7-49de-9a68-820f6bacc031 req-e2ab3881-5e57-407d-aa49-e971979067ea tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1938946 Dec 08 11:41:17.010269 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4236a4bb-5669-4c6f-9fba-8a58cebfd258 req-31ecdaf7-dc3c-4425-a33c-2bd6bb53e4f4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:17.011708 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4236a4bb-5669-4c6f-9fba-8a58cebfd258 req-31ecdaf7-dc3c-4425-a33c-2bd6bb53e4f4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.1442444 Dec 08 11:41:17.015800 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-0ca8e7ff-7669-4387-a688-e079a7b369ff service neutron] 10.222.0.61 "GET /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2375400 Dec 08 11:41:17.016874 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22286cd1-4da8-4699-97a2-e52720c71771 req-cdd87553-9fc3-4eef-aef8-918bee053336 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:17.018232 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22286cd1-4da8-4699-97a2-e52720c71771 req-cdd87553-9fc3-4eef-aef8-918bee053336 service neutron] 10.222.0.61 "GET /v2.0/networks?id=fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 200 len: 917 time: 0.2524858 Dec 08 11:41:17.105384 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4236a4bb-5669-4c6f-9fba-8a58cebfd258 req-6e1998db-515b-4853-9cb6-4c4a88a9e6f4 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0861273 Dec 08 11:41:17.115331 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22286cd1-4da8-4699-97a2-e52720c71771 req-a99c1c37-f0dc-4efa-b1bc-f4d026a3c3c8 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee HTTP/1.1" status: 200 len: 999 time: 0.0827229 Dec 08 11:41:17.165818 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22286cd1-4da8-4699-97a2-e52720c71771 req-ba87afb1-c2b0-4c46-9713-8a36f577e87e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:17.167238 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22286cd1-4da8-4699-97a2-e52720c71771 req-ba87afb1-c2b0-4c46-9713-8a36f577e87e service neutron] 10.222.0.61 "GET /v2.0/subnets?id=62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 200 len: 855 time: 0.0439901 Dec 08 11:41:17.216763 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22286cd1-4da8-4699-97a2-e52720c71771 req-c1ce4cbb-6c98-4012-a858-b5e3d11123cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:17.218286 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22286cd1-4da8-4699-97a2-e52720c71771 req-c1ce4cbb-6c98-4012-a858-b5e3d11123cc service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=fd37a1fc-3614-462b-92a2-b41260c949a2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0429490 Dec 08 11:41:17.312384 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22286cd1-4da8-4699-97a2-e52720c71771 req-47bf6ff7-c712-40f7-bfb6-7dbd10930665 service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852189 Dec 08 11:41:17.402728 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-22286cd1-4da8-4699-97a2-e52720c71771 req-c944951f-3ac7-4fcb-b03d-af891724dd1b service neutron] 10.222.0.61 "GET /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812385 Dec 08 11:41:17.691944 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:18.117167 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c5844af-3c26-44a6-ab92-1fff3563db19 req-610b9c09-bbb5-438d-ac74-b56c068a9776 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:18.118657 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5c5844af-3c26-44a6-ab92-1fff3563db19 req-610b9c09-bbb5-438d-ac74-b56c068a9776 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0539260 Dec 08 11:41:18.168093 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5c5844af-3c26-44a6-ab92-1fff3563db19 req-d59a3e02-3cd9-4acc-8eb8-e5b45c9747a8 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/security-groups?id=e5627452-bf2d-4afd-bd70-91f75757db97&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435240 Dec 08 11:41:18.226839 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b902a0fd-e012-438d-85d0-60a42563dda5 req-05ab6c52-9297-4d13-889f-15b35c6a680b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:18.228288 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b902a0fd-e012-438d-85d0-60a42563dda5 req-05ab6c52-9297-4d13-889f-15b35c6a680b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0503528 Dec 08 11:41:18.274220 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b902a0fd-e012-438d-85d0-60a42563dda5 req-44fcb1f1-e3d1-45c2-94e7-260bf96e6b53 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400229 Dec 08 11:41:18.334715 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff536ee-1375-4b82-ab24-326f6a7428e8 req-48383214-98d2-41a4-9fb4-49a9cd349b79 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:18.336672 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cff536ee-1375-4b82-ab24-326f6a7428e8 req-48383214-98d2-41a4-9fb4-49a9cd349b79 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.61 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 945 time: 0.0472565 Dec 08 11:41:18.452297 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-cff536ee-1375-4b82-ab24-326f6a7428e8 req-c1c793c1-2555-4606-a01d-f4e07b82f2da tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Deleting port 79e98205-d459-4886-827e-71b058999e30 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:18.452641 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cff536ee-1375-4b82-ab24-326f6a7428e8 req-c1c793c1-2555-4606-a01d-f4e07b82f2da tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:18.571361 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-cff536ee-1375-4b82-ab24-326f6a7428e8 req-c1c793c1-2555-4606-a01d-f4e07b82f2da tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] For port 79e98205-d459-4886-827e-71b058999e30, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=79e98205-d459-4886-827e-71b058999e30,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:18.571724 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cff536ee-1375-4b82-ab24-326f6a7428e8 req-c1c793c1-2555-4606-a01d-f4e07b82f2da tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:18.583129 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-cff536ee-1375-4b82-ab24-326f6a7428e8 req-c1c793c1-2555-4606-a01d-f4e07b82f2da tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Calling delete_port for 79e98205-d459-4886-827e-71b058999e30 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:18.706495 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cff536ee-1375-4b82-ab24-326f6a7428e8 req-c1c793c1-2555-4606-a01d-f4e07b82f2da tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:18.738078 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c793c1-2555-4606-a01d-f4e07b82f2da tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Pushing event deleted for resources: {'Port': ['ID=79e98205-d459-4886-827e-71b058999e30,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:18.780380 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-cff536ee-1375-4b82-ab24-326f6a7428e8 req-c1c793c1-2555-4606-a01d-f4e07b82f2da tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] No DVR routers for this DVR port 79e98205-d459-4886-827e-71b058999e30 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:41:18.782859 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-cff536ee-1375-4b82-ab24-326f6a7428e8 req-c1c793c1-2555-4606-a01d-f4e07b82f2da tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:18.786248 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cff536ee-1375-4b82-ab24-326f6a7428e8 req-c1c793c1-2555-4606-a01d-f4e07b82f2da tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.61 "DELETE /v2.0/ports/79e98205-d459-4886-827e-71b058999e30 HTTP/1.1" status: 204 len: 173 time: 0.4424527 Dec 08 11:41:18.786687 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'name': 'network-vif-deleted', 'tag': '79e98205-d459-4886-827e-71b058999e30'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:41:18.788913 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9a6316f8-fdb9-41cc-9c4b-cc005efdb51f" -d '{"events": [{"server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "name": "network-vif-deleted", "tag": "79e98205-d459-4886-827e-71b058999e30"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:41:18.825247 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:41:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6ae720e-9c70-476e-b5e6-51997325a5bc x-openstack-request-id: req-e6ae720e-9c70-476e-b5e6-51997325a5bc {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:41:18.825552 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1", "name": "network-vif-deleted", "tag": "79e98205-d459-4886-827e-71b058999e30", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:41:18.825810 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-e6ae720e-9c70-476e-b5e6-51997325a5bc {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:41:18.826210 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1', 'name': 'network-vif-deleted', 'tag': '79e98205-d459-4886-827e-71b058999e30', 'status': 'completed', 'code': 200} Dec 08 11:41:19.275168 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-81c43de3-552a-4520-985c-45aa763a69f5 req-5685b22d-3217-40a7-aec1-a023cc23bb40 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "GET /v2.0/ports?device_id=3fce1d7f-58a9-4dc0-869a-12d6a9c70ab1 HTTP/1.1" status: 200 len: 210 time: 0.0264506 Dec 08 11:41:19.406887 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a80638-d11c-4ab9-b635-388d2620a3be req-70d81feb-42d6-4b9f-bc8d-8f24624d3ea6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:19.407841 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-82a80638-d11c-4ab9-b635-388d2620a3be req-70d81feb-42d6-4b9f-bc8d-8f24624d3ea6 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0572188 Dec 08 11:41:19.458286 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-82a80638-d11c-4ab9-b635-388d2620a3be req-d7971681-bdad-4f81-9eb9-7e416188e85a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438840 Dec 08 11:41:20.329886 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58670) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:20.387355 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-56209d46-3768-469b-8dd1-ece79ad51699 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:20.406086 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:41:20.408654 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 79e98205-d459-4886-827e-71b058999e30 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:41:20.411885 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-56209d46-3768-469b-8dd1-ece79ad51699 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:20.433064 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 79e98205-d459-4886-827e-71b058999e30 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:41:20.433434 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 79e98205-d459-4886-827e-71b058999e30 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:41:20.472913 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-56209d46-3768-469b-8dd1-ece79ad51699 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:20.476686 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-56209d46-3768-469b-8dd1-ece79ad51699 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:20.480236 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-56209d46-3768-469b-8dd1-ece79ad51699 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] 10.222.0.66 "DELETE /v2.0/security-groups/e5627452-bf2d-4afd-bd70-91f75757db97 HTTP/1.1" status: 204 len: 168 time: 0.1492994 Dec 08 11:41:20.489827 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56209d46-3768-469b-8dd1-ece79ad51699 tempest-TestShelveInstance-1004012365 tempest-TestShelveInstance-1004012365-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5627452-bf2d-4afd-bd70-91f75757db97,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:20.535207 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:20.535416 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58676) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:20.548370 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'port_id': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'mac_address': 'fa:16:3e:63:16:88', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 278, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:41:20.588643 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:20.603765 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:41:20.621849 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-060f0521-fd90-4b93-9e26-fd05e915125d req-26e91516-25e9-4b92-93e0-8637315f066a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:20.623334 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-060f0521-fd90-4b93-9e26-fd05e915125d req-26e91516-25e9-4b92-93e0-8637315f066a tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 944 time: 0.0510819 Dec 08 11:41:20.625556 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:20.629777 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:20.674166 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-060f0521-fd90-4b93-9e26-fd05e915125d req-3bf17533-ecb8-4715-a46f-171baed02b48 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441740 Dec 08 11:41:20.678938 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,revision_number=9']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:21.030037 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:41:21.176751 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7897011'] for router_interface, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:21.418554 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Deleting port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 {{(pid=102317) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:21.418891 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:21.498046 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] For port d5964107-ee0c-4bb0-ad4c-8179b4fa75a2, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=d5964107-ee0c-4bb0-ad4c-8179b4fa75a2,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102317) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:21.498436 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:21.511458 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Calling delete_port for d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 owned by network:router_interface {{(pid=102317) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:21.689210 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:21.714354 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Pushing event deleted for resources: {'Port': ['ID=d5964107-ee0c-4bb0-ad4c-8179b4fa75a2,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:21.722368 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:21.722718 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:21.723107 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:21.723374 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:21.723701 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:21.724024 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:21.724350 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:21.724670 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:21.725001 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:21.725356 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:21.726183 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:21.726522 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:21.726837 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:21.816486 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25cb5fb7-0146-4e89-b967-7b3f52cdc62b req-17ca9306-f182-4db3-bdb2-0f151e7c7013 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:21.818186 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-25cb5fb7-0146-4e89-b967-7b3f52cdc62b req-17ca9306-f182-4db3-bdb2-0f151e7c7013 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 945 time: 0.0585272 Dec 08 11:41:21.879389 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-25cb5fb7-0146-4e89-b967-7b3f52cdc62b req-e26d939d-8d1f-48d9-9457-98998f316a92 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0550745 Dec 08 11:41:21.904897 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8074906', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7896871'] for router_interface, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:22.117734 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:41:22.224068 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:41:22.229671 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-fdb7d26f-6867-4d66-878a-340588d5bd50 admin admin] 10.222.0.66 "PUT /v2.0/routers/3a9d62c0-7438-4191-89d6-70be7d9ccc6c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6931500 Dec 08 11:41:22.232177 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58688) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:22.234049 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62f0c235-8491-4cfb-b2ce-4a8451c0cecd None None] Sync routers for ids ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:41:22.243969 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62f0c235-8491-4cfb-b2ce-4a8451c0cecd None None] Routers {'3a9d62c0-7438-4191-89d6-70be7d9ccc6c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:41:22.244579 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-62f0c235-8491-4cfb-b2ce-4a8451c0cecd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:40:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:22.332033 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Publish callbacks [] for router, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:22.347652 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-62f0c235-8491-4cfb-b2ce-4a8451c0cecd None None] Set router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:41:22.434008 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:22.435728 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:41:22.488526 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Deleting port e23bf4db-f0fa-4fe3-87ca-91680effc04b {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:22.488861 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:22.501760 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-de2c0040-cfde-4c61-a239-b679f026a8bf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:22.563179 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:41:22.563556 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:22.570974 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] For port e23bf4db-f0fa-4fe3-87ca-91680effc04b, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=e23bf4db-f0fa-4fe3-87ca-91680effc04b,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:22.571357 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:22.583952 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Calling delete_port for e23bf4db-f0fa-4fe3-87ca-91680effc04b owned by network:router_gateway {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:22.649499 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-62f0c235-8491-4cfb-b2ce-4a8451c0cecd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18'}], 'enable_snat': True}, 'gw_port_id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:41:21Z', 'revision_number': 5, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port': {'id': 'e23bf4db-f0fa-4fe3-87ca-91680effc04b', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:43:93:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 352, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.18', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:33:46Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:22.748007 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:22.777652 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Pushing event deleted for resources: {'Port': ['ID=e23bf4db-f0fa-4fe3-87ca-91680effc04b,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:22.810793 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62f0c235-8491-4cfb-b2ce-4a8451c0cecd None None] Checking router: 3a9d62c0-7438-4191-89d6-70be7d9ccc6c for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:41:22.822225 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:22.836614 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62f0c235-8491-4cfb-b2ce-4a8451c0cecd None None] Routers {'3a9d62c0-7438-4191-89d6-70be7d9ccc6c'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:41:22.837284 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-62f0c235-8491-4cfb-b2ce-4a8451c0cecd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:40:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:22.845582 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7889737'] for router_gateway, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:22.880058 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:41:22.882880 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8c83e9ee-849e-4065-abb7-2d7cc72eff45" -d '{"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-plugged", "status": "completed", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:41:22.927940 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:22.930030 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-62f0c235-8491-4cfb-b2ce-4a8451c0cecd None None] Set router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c gateway port host: None {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:41:22.932841 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:41:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1ef84210-0f52-4f0f-bec6-7773629c0501 x-openstack-request-id: req-1ef84210-0f52-4f0f-bec6-7773629c0501 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:41:22.932999 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-plugged", "status": "completed", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:41:22.933117 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-1ef84210-0f52-4f0f-bec6-7773629c0501 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:41:22.933579 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'code': 200} Dec 08 11:41:22.952980 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7895253', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32185'] for router, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:22.956515 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:22.959908 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:22.992777 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-62f0c235-8491-4cfb-b2ce-4a8451c0cecd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:41:22Z', 'revision_number': 7, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port_host': None}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:23.038513 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7895086'] for router, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.039562 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3a9d62c0-7438-4191-89d6-70be7d9ccc6c {{(pid=102318) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 08 11:41:23.041821 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62f0c235-8491-4cfb-b2ce-4a8451c0cecd None None] The sync data for ids ['3a9d62c0-7438-4191-89d6-70be7d9ccc6c'] in dv-cinder-819778-3-iscsi is: [{'id': '3a9d62c0-7438-4191-89d6-70be7d9ccc6c', 'name': 'tempest-TestShelveInstance-1020415369-router', 'tenant_id': '23027f58b51142389f64405702a0fcd3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:42Z', 'updated_at': '2021-12-08T11:41:22Z', 'revision_number': 7, 'project_id': '23027f58b51142389f64405702a0fcd3', 'gw_port_host': None}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:41:23.045279 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] Publish callbacks [] for router, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.046422 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-01f16226-3e6a-4156-bea3-42af24b12d77 admin admin] 10.222.0.66 "DELETE /v2.0/routers/3a9d62c0-7438-4191-89d6-70be7d9ccc6c HTTP/1.1" status: 204 len: 168 time: 0.8132358 Dec 08 11:41:23.049391 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58694) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:23.070383 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,revision_number=10']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:23.076456 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f21b521-387a-4490-883d-e37bdb21545f req-c8a1500f-2386-4a41-ad69-08b96a29a215 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:23.078083 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6f21b521-387a-4490-883d-e37bdb21545f req-c8a1500f-2386-4a41-ad69-08b96a29a215 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 947 time: 0.0794985 Dec 08 11:41:23.137107 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_v2 [None req-09498d02-6779-4666-9be2-c9d025d3cf01 admin admin] Deleting subnet 59081569-032b-42c0-afce-26c79ceb7aac {{(pid=102317) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:41:23.140423 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-09498d02-6779-4666-9be2-c9d025d3cf01 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.157408 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6f21b521-387a-4490-883d-e37bdb21545f req-888cc88d-0ec5-4edb-a427-737387df3512 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0724716 Dec 08 11:41:23.163680 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8952e54-497d-45da-9d9d-8b052d1c5a12 req-941bef5b-5244-4a9a-a024-9890cd06c6dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:23.165173 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f8952e54-497d-45da-9d9d-8b052d1c5a12 req-941bef5b-5244-4a9a-a024-9890cd06c6dc service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 1100 time: 0.0646110 Dec 08 11:41:23.183254 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-09498d02-6779-4666-9be2-c9d025d3cf01 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4850389'] for subnet, precommit_delete_associations {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.217118 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f8952e54-497d-45da-9d9d-8b052d1c5a12 req-58815a4d-9cc5-448a-b815-540f65e24d60 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432224 Dec 08 11:41:23.294455 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-09498d02-6779-4666-9be2-c9d025d3cf01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.345824 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-09498d02-6779-4666-9be2-c9d025d3cf01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5645791', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5419674'] for subnet, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.373864 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-09498d02-6779-4666-9be2-c9d025d3cf01 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.378513 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de9dfcea-fcb8-4f41-acb3-ccc267503bd2 None None] Network 55a129bc-8ce3-4aac-98fb-64f16c4a4949 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:41:23.379022 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-09498d02-6779-4666-9be2-c9d025d3cf01 admin admin] 10.222.0.66 "DELETE /v2.0/subnets/59081569-032b-42c0-afce-26c79ceb7aac HTTP/1.1" status: 204 len: 168 time: 0.3276241 Dec 08 11:41:23.379789 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09498d02-6779-4666-9be2-c9d025d3cf01 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=59081569-032b-42c0-afce-26c79ceb7aac,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:23.383380 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58698) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:23.459389 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.519817 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Deleting port 064410a8-b2e5-4789-9240-676ef2afbf8a {{(pid=102317) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:23.520217 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.583798 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] For port 064410a8-b2e5-4789-9240-676ef2afbf8a, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=064410a8-b2e5-4789-9240-676ef2afbf8a,segment=NetworkSegment(0f102544-c85b-462f-95c4-8c4e0e813aa2),segment_id=0f102544-c85b-462f-95c4-8c4e0e813aa2)] {{(pid=102317) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:23.584179 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.597503 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Calling delete_port for 064410a8-b2e5-4789-9240-676ef2afbf8a owned by network:dhcp {{(pid=102317) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:23.674326 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.698286 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Pushing event deleted for resources: {'Port': ['ID=064410a8-b2e5-4789-9240-676ef2afbf8a,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:23.701891 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] No DVR routers for this DVR port 064410a8-b2e5-4789-9240-676ef2afbf8a on host dv-cinder-819778-3-iscsi {{(pid=102317) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:41:23.776199 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.795481 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['55a129bc-8ce3-4aac-98fb-64f16c4a4949']}} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:23.804915 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0f102544-c85b-462f-95c4-8c4e0e813aa2') {'for_net_delete': True} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:23.805239 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0f102544-c85b-462f-95c4-8c4e0e813aa2') {} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:23.814432 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4850398'] for segment, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.828597 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.834741 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Releasing vlan 262 on physical network physnet1 to pool {{(pid=102317) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:41:23.835083 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5648505'] for segment, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: Traceback (most recent call last): Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: timer() Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: cb(*args, **kw) Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: return func(*args, **kwargs) Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: self._notify() Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: self.callback(batched_events) Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: event.method(event) Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: return f(self, *a, **k) Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._get(url).json() Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: return self.request(url, 'GET', **kwargs) Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:41:23.836705 dv-cinder-819778-3-iscsi neutron-server[102317]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:41:23.854936 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fab68c05-6b92-4051-b1dc-ae5a50ac7d14 None None] DHCP port deletion for 55a129bc-8ce3-4aac-98fb-64f16c4a4949 request from dv-cinder-819778-3-iscsi {{(pid=102319) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 08 11:41:23.898278 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.907751 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:23.911177 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] 10.222.0.66 "DELETE /v2.0/networks/55a129bc-8ce3-4aac-98fb-64f16c4a4949 HTTP/1.1" status: 204 len: 168 time: 0.5268092 Dec 08 11:41:23.914658 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58700) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:23.921282 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d54af08-7b49-4bce-bd65-4c1cde6edc09 admin admin] Pushing event deleted for resources: {'Network': ['ID=55a129bc-8ce3-4aac-98fb-64f16c4a4949,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:24.307089 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fefa21e-06be-4ae5-9846-5310fd25e384 req-ec364c1f-181a-4c25-807f-2eca91a66d54 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:24.308546 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2fefa21e-06be-4ae5-9846-5310fd25e384 req-ec364c1f-181a-4c25-807f-2eca91a66d54 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 947 time: 0.0598595 Dec 08 11:41:24.315185 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e1ee3f2a-1f90-4b98-a94a-8cd7c3f494f8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7897011'] for router_interface, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:24.428014 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2fefa21e-06be-4ae5-9846-5310fd25e384 req-36b301fb-6b39-4ad6-9947-7a554ca72a21 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1101048 Dec 08 11:41:24.589394 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-e1ee3f2a-1f90-4b98-a94a-8cd7c3f494f8 admin admin] Deleting port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:24.589728 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e1ee3f2a-1f90-4b98-a94a-8cd7c3f494f8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:24.589852 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:41:24.609842 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:41:24.610246 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device d5964107-ee0c-4bb0-ad4c-8179b4fa75a2 not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:41:24.610620 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 064410a8-b2e5-4789-9240-676ef2afbf8a no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:41:24.630760 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 064410a8-b2e5-4789-9240-676ef2afbf8a {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:41:24.631104 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 064410a8-b2e5-4789-9240-676ef2afbf8a not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:41:24.631522 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device e23bf4db-f0fa-4fe3-87ca-91680effc04b no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:41:24.654803 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: e23bf4db-f0fa-4fe3-87ca-91680effc04b {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:41:24.655249 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device e23bf4db-f0fa-4fe3-87ca-91680effc04b not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:41:24.670534 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-e1ee3f2a-1f90-4b98-a94a-8cd7c3f494f8 admin admin] For port cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca,segment=NetworkSegment(92b354b3-d3c3-4161-9c7f-a3df7bfcf34b),segment_id=92b354b3-d3c3-4161-9c7f-a3df7bfcf34b)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:24.670899 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e1ee3f2a-1f90-4b98-a94a-8cd7c3f494f8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:24.684316 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-e1ee3f2a-1f90-4b98-a94a-8cd7c3f494f8 admin admin] Calling delete_port for cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca owned by network:router_interface {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:24.705876 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0387197d-1ee6-4768-82c9-e01f58ba3282 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:25.151983 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e1ee3f2a-1f90-4b98-a94a-8cd7c3f494f8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:25.176953 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1ee3f2a-1f90-4b98-a94a-8cd7c3f494f8 admin admin] Pushing event deleted for resources: {'Port': ['ID=cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:25.369452 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-e1ee3f2a-1f90-4b98-a94a-8cd7c3f494f8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8074906', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7896871'] for router_interface, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:25.619340 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec2f4714-be9c-4357-aabb-ab8573434387 req-6548e752-50d7-47c4-99d3-47bd564479b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:25.620863 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ec2f4714-be9c-4357-aabb-ab8573434387 req-6548e752-50d7-47c4-99d3-47bd564479b1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 947 time: 0.0971663 Dec 08 11:41:25.639856 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e1ee3f2a-1f90-4b98-a94a-8cd7c3f494f8 admin admin] Router 613f8c98-e083-4296-b340-59fc1326e708 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:41:25.770622 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e1ee3f2a-1f90-4b98-a94a-8cd7c3f494f8 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:41:25.783572 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-288a11b6-f19c-45a3-b9e9-905da092b92c None None] Sync routers for ids ['613f8c98-e083-4296-b340-59fc1326e708'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:41:25.784769 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-e1ee3f2a-1f90-4b98-a94a-8cd7c3f494f8 admin admin] 10.222.0.66 "PUT /v2.0/routers/613f8c98-e083-4296-b340-59fc1326e708/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8679340 Dec 08 11:41:25.786177 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58758) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:25.799694 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-288a11b6-f19c-45a3-b9e9-905da092b92c None None] Routers {'613f8c98-e083-4296-b340-59fc1326e708'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:41:25.800349 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-288a11b6-f19c-45a3-b9e9-905da092b92c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:41:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['613f8c98-e083-4296-b340-59fc1326e708'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:25.818773 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:25.926234 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ec2f4714-be9c-4357-aabb-ab8573434387 req-e826e9c2-e328-473c-b36d-dcf9f34b8878 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2960455 Dec 08 11:41:25.948846 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Publish callbacks [] for router, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:25.997638 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-288a11b6-f19c-45a3-b9e9-905da092b92c None None] Set router 613f8c98-e083-4296-b340-59fc1326e708 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:41:26.051068 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.106716 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Deleting port fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:26.107049 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.171968 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-288a11b6-f19c-45a3-b9e9-905da092b92c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '613f8c98-e083-4296-b340-59fc1326e708', 'name': 'tempest-TestShelveInstance-881503333-router', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38'}], 'enable_snat': True}, 'gw_port_id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:46Z', 'updated_at': '2021-12-08T11:41:24Z', 'revision_number': 5, 'project_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'gw_port': {'id': 'fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:25:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '613f8c98-e083-4296-b340-59fc1326e708', 'device_owner': 'network:router_gateway', 'standard_attr_id': 364, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.38', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:33:47Z', 'updated_at': '2021-12-08T11:33:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:26.184090 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] For port fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:26.184614 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.197298 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Calling delete_port for fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf owned by network:router_gateway {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:26.197947 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-288a11b6-f19c-45a3-b9e9-905da092b92c None None] Checking router: 613f8c98-e083-4296-b340-59fc1326e708 for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:41:26.206736 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-288a11b6-f19c-45a3-b9e9-905da092b92c None None] Routers {'613f8c98-e083-4296-b340-59fc1326e708'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:41:26.207351 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-288a11b6-f19c-45a3-b9e9-905da092b92c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:41:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['613f8c98-e083-4296-b340-59fc1326e708'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:26.292920 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-288a11b6-f19c-45a3-b9e9-905da092b92c None None] Set router 613f8c98-e083-4296-b340-59fc1326e708 gateway port host: None {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:41:26.347453 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-288a11b6-f19c-45a3-b9e9-905da092b92c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '613f8c98-e083-4296-b340-59fc1326e708', 'name': 'tempest-TestShelveInstance-881503333-router', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:46Z', 'updated_at': '2021-12-08T11:41:26Z', 'revision_number': 6, 'project_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'gw_port_host': None}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:26.359740 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.374468 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-288a11b6-f19c-45a3-b9e9-905da092b92c None None] The sync data for ids ['613f8c98-e083-4296-b340-59fc1326e708'] in dv-cinder-819778-3-iscsi is: [{'id': '613f8c98-e083-4296-b340-59fc1326e708', 'name': 'tempest-TestShelveInstance-881503333-router', 'tenant_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:33:46Z', 'updated_at': '2021-12-08T11:41:26Z', 'revision_number': 6, 'project_id': '20baef90cfd14c1eb1cc9cc518ab39b8', 'gw_port_host': None}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:41:26.387141 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Pushing event deleted for resources: {'Port': ['ID=fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:26.451434 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7889737'] for router_gateway, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.538858 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7895253', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32185'] for router, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.540981 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.583684 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7895086'] for router, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.584279 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 613f8c98-e083-4296-b340-59fc1326e708 {{(pid=102318) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 08 11:41:26.589197 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] Publish callbacks [] for router, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.590354 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-437ccf24-7a16-41f4-a7da-631533f52e68 admin admin] 10.222.0.66 "DELETE /v2.0/routers/613f8c98-e083-4296-b340-59fc1326e708 HTTP/1.1" status: 204 len: 168 time: 0.8030355 Dec 08 11:41:26.592812 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58762) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:26.636857 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_v2 [None req-7e0be1ec-052c-42c7-ac78-1b5ddce2968e admin admin] Deleting subnet da2c65e5-a2e3-49fe-9217-53524b9f6c77 {{(pid=102318) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:41:26.640268 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7e0be1ec-052c-42c7-ac78-1b5ddce2968e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.677343 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7e0be1ec-052c-42c7-ac78-1b5ddce2968e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16370044'] for subnet, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.757472 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7e0be1ec-052c-42c7-ac78-1b5ddce2968e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.820900 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7e0be1ec-052c-42c7-ac78-1b5ddce2968e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4572160', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-16496636'] for subnet, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.845713 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e0be1ec-052c-42c7-ac78-1b5ddce2968e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=da2c65e5-a2e3-49fe-9217-53524b9f6c77,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:26.849292 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-7e0be1ec-052c-42c7-ac78-1b5ddce2968e admin admin] Publish callbacks [] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.855658 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58768) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:26.856160 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-7e0be1ec-052c-42c7-ac78-1b5ddce2968e admin admin] 10.222.0.66 "DELETE /v2.0/subnets/da2c65e5-a2e3-49fe-9217-53524b9f6c77 HTTP/1.1" status: 204 len: 168 time: 0.2619157 Dec 08 11:41:26.858634 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4e6f5fc-00be-4ba9-abd6-02ab6afb2f0b None None] Network b60280a9-c9a1-4339-81c7-6d947b10537a requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:41:26.924061 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:26.979428 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Deleting port cee6fedc-1958-4f00-867a-97fe064dffea {{(pid=102317) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:26.979765 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.051863 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] For port cee6fedc-1958-4f00-867a-97fe064dffea, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=cee6fedc-1958-4f00-867a-97fe064dffea,segment=NetworkSegment(92b354b3-d3c3-4161-9c7f-a3df7bfcf34b),segment_id=92b354b3-d3c3-4161-9c7f-a3df7bfcf34b)] {{(pid=102317) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:27.052253 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.067180 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Calling delete_port for cee6fedc-1958-4f00-867a-97fe064dffea owned by network:dhcp {{(pid=102317) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:27.155286 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79b4d4b2-5687-4091-9f7c-162d9341e56a None None] DHCP port deletion for b60280a9-c9a1-4339-81c7-6d947b10537a request from dv-cinder-819778-3-iscsi {{(pid=102319) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 08 11:41:27.163712 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:41:27.168296 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.191285 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:41:27.191633 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device cf07d808-cf8e-4ce3-b2c6-7cb7a332fbca not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:41:27.218168 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Pushing event deleted for resources: {'Port': ['ID=cee6fedc-1958-4f00-867a-97fe064dffea,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:27.222845 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] No DVR routers for this DVR port cee6fedc-1958-4f00-867a-97fe064dffea on host dv-cinder-819778-3-iscsi {{(pid=102317) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:41:27.237506 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-79b4d4b2-5687-4091-9f7c-162d9341e56a None None] The port 'cee6fedc-1958-4f00-867a-97fe064dffea' was deleted {{(pid=102319) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1958}} Dec 08 11:41:27.239055 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.311543 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.334287 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b60280a9-c9a1-4339-81c7-6d947b10537a']}} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:27.344724 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '92b354b3-d3c3-4161-9c7f-a3df7bfcf34b') {'for_net_delete': True} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:27.345024 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '92b354b3-d3c3-4161-9c7f-a3df7bfcf34b') {} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:27.355675 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4850398'] for segment, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.369120 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.375673 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Releasing vlan 286 on physical network physnet1 to pool {{(pid=102317) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:41:27.376067 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5648505'] for segment, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: Traceback (most recent call last): Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: timer() Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: cb(*args, **kw) Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: return func(*args, **kwargs) Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: self._notify() Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: self.callback(batched_events) Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: event.method(event) Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: return f(self, *a, **k) Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._get(url).json() Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: return self.request(url, 'GET', **kwargs) Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:41:27.377811 dv-cinder-819778-3-iscsi neutron-server[102317]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:41:27.436277 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.442053 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.445861 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] 10.222.0.66 "DELETE /v2.0/networks/b60280a9-c9a1-4339-81c7-6d947b10537a HTTP/1.1" status: 204 len: 168 time: 0.5891728 Dec 08 11:41:27.458818 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8afa12d-e5da-4918-955e-500669a016f3 admin admin] Pushing event deleted for resources: {'Network': ['ID=b60280a9-c9a1-4339-81c7-6d947b10537a,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:27.563562 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58780) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:27.604203 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-8e2b815f-3c0d-4024-9f72-774021504db9 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=23027f58b51142389f64405702a0fcd3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0393927 Dec 08 11:41:27.606776 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58782) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:27.655477 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-810e1c80-c528-48c2-9037-4e36d71e66f1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.679133 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-810e1c80-c528-48c2-9037-4e36d71e66f1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.723612 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-810e1c80-c528-48c2-9037-4e36d71e66f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.726545 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-810e1c80-c528-48c2-9037-4e36d71e66f1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:27.727764 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-810e1c80-c528-48c2-9037-4e36d71e66f1 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/5e6d8ccc-43be-4915-93e4-5436bd7a1993 HTTP/1.1" status: 204 len: 168 time: 0.1200640 Dec 08 11:41:27.735204 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-810e1c80-c528-48c2-9037-4e36d71e66f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e6d8ccc-43be-4915-93e4-5436bd7a1993,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:28.035103 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58788) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:28.077089 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-1902569a-ebf9-48e1-b6af-ea742173751a admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=20baef90cfd14c1eb1cc9cc518ab39b8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0408351 Dec 08 11:41:28.079599 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58790) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:28.125436 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-862b3cc2-3ce4-45a9-b6c8-2f49bd1b17f8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:28.146467 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-862b3cc2-3ce4-45a9-b6c8-2f49bd1b17f8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:28.167793 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:28.191639 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-862b3cc2-3ce4-45a9-b6c8-2f49bd1b17f8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:28.194813 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-862b3cc2-3ce4-45a9-b6c8-2f49bd1b17f8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:28.195946 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-862b3cc2-3ce4-45a9-b6c8-2f49bd1b17f8 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/15975ea4-ee4a-42fb-b4f4-4bb97d00d1ae HTTP/1.1" status: 204 len: 168 time: 0.1154499 Dec 08 11:41:28.204112 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-862b3cc2-3ce4-45a9-b6c8-2f49bd1b17f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=15975ea4-ee4a-42fb-b4f4-4bb97d00d1ae,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:28.564893 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:41:28.584307 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:41:28.584652 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device fb7d4641-fe1a-4137-9ad6-bc9ada3f1ebf not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:41:28.585062 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device cee6fedc-1958-4f00-867a-97fe064dffea no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:41:28.603526 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: cee6fedc-1958-4f00-867a-97fe064dffea {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:41:28.603873 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device cee6fedc-1958-4f00-867a-97fe064dffea not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:41:34.890842 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:41:37.955586 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2b8bd7d-2c41-4068-82e1-15c1231a220f req-e219ab2d-a302-44ee-bcc2-c1a0a9a405b4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:37.956984 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e2b8bd7d-2c41-4068-82e1-15c1231a220f req-e219ab2d-a302-44ee-bcc2-c1a0a9a405b4 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 946 time: 0.0557408 Dec 08 11:41:38.002926 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e2b8bd7d-2c41-4068-82e1-15c1231a220f req-5334fed0-d16b-45f7-af07-10b444d22f22 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=d942334b-e776-48d7-bdd4-04c6cf5975fa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399890 Dec 08 11:41:39.119908 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8847f01-06d4-4ae0-867b-6ef6c9db8202 req-1c9c477c-fe19-42a4-ad0a-227c8f420d68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:39.121402 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c8847f01-06d4-4ae0-867b-6ef6c9db8202 req-1c9c477c-fe19-42a4-ad0a-227c8f420d68 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 946 time: 0.0498273 Dec 08 11:41:39.167908 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c8847f01-06d4-4ae0-867b-6ef6c9db8202 req-0d863c7e-2d11-43e9-87a9-2207f6e02957 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=d942334b-e776-48d7-bdd4-04c6cf5975fa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0405977 Dec 08 11:41:39.982060 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-9c0625b3-073f-40c8-9482-b5e2d632fc84 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:39.983467 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-9c0625b3-073f-40c8-9482-b5e2d632fc84 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.61 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 946 time: 0.0513990 Dec 08 11:41:40.069835 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Deleting port 973b8088-0638-45a6-9fe0-acffa26314d2 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:40.070773 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:40.157556 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] For port 973b8088-0638-45a6-9fe0-acffa26314d2, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=973b8088-0638-45a6-9fe0-acffa26314d2,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:40.158250 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:40.345449 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0082ee88-ab93-43bf-8049-4690ffd5c333 req-8879576c-fa37-434f-b3f8-a140b6a9a614 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:41:40.346922 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0082ee88-ab93-43bf-8049-4690ffd5c333 req-8879576c-fa37-434f-b3f8-a140b6a9a614 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/ports?device_id=7f2f2abb-3bae-48d7-a02d-420f509114ca HTTP/1.1" status: 200 len: 946 time: 0.0955255 Dec 08 11:41:40.367765 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:40.368120 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:40.368430 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Floating IP e2179aba-a80b-4ecc-a7cd-65324ecfe007 disassociated. External IP: 172.27.2.130, port: 973b8088-0638-45a6-9fe0-acffa26314d2. Dec 08 11:41:40.368766 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling delete_port for 973b8088-0638-45a6-9fe0-acffa26314d2 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:40.444271 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-0082ee88-ab93-43bf-8049-4690ffd5c333 req-338fcf3b-0384-43a0-925c-2b57bd24e3f9 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups?id=d942334b-e776-48d7-bdd4-04c6cf5975fa&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0884197 Dec 08 11:41:40.523592 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:40.551884 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event deleted for resources: {'Port': ['ID=973b8088-0638-45a6-9fe0-acffa26314d2,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:40.661194 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Router e1280faa-8f3b-40a4-8270-5461288df246 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:41:40.769003 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:41:40.779934 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77e5e6c1-2019-416d-b01a-5cff641b449a None None] Sync routers for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:41:40.790855 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77e5e6c1-2019-416d-b01a-5cff641b449a None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:41:40.791460 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-77e5e6c1-2019-416d-b01a-5cff641b449a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:41:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:40.810257 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] No DVR routers for this DVR port 973b8088-0638-45a6-9fe0-acffa26314d2 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:41:40.812768 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:40.816034 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-72743492-cd7e-4b13-a3d6-3614de35cb19 req-ad6c26d4-d11a-4952-8aab-31e62095a9c1 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.61 "DELETE /v2.0/ports/973b8088-0638-45a6-9fe0-acffa26314d2 HTTP/1.1" status: 204 len: 173 time: 0.8249922 Dec 08 11:41:40.816469 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7f2f2abb-3bae-48d7-a02d-420f509114ca', 'name': 'network-vif-deleted', 'tag': '973b8088-0638-45a6-9fe0-acffa26314d2'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:41:40.818741 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-94ba1e45-05fc-450d-a7a5-a98a5a1ad31a" -d '{"events": [{"server_uuid": "7f2f2abb-3bae-48d7-a02d-420f509114ca", "name": "network-vif-deleted", "tag": "973b8088-0638-45a6-9fe0-acffa26314d2"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:41:40.920982 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-77e5e6c1-2019-416d-b01a-5cff641b449a None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:41:41.074532 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:41:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6e9a19d7-8a0c-4d4c-8229-87ba753953ed x-openstack-request-id: req-6e9a19d7-8a0c-4d4c-8229-87ba753953ed {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:41:41.074830 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7f2f2abb-3bae-48d7-a02d-420f509114ca", "name": "network-vif-deleted", "tag": "973b8088-0638-45a6-9fe0-acffa26314d2", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:41:41.075083 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-6e9a19d7-8a0c-4d4c-8229-87ba753953ed {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:41:41.075479 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7f2f2abb-3bae-48d7-a02d-420f509114ca', 'name': 'network-vif-deleted', 'tag': '973b8088-0638-45a6-9fe0-acffa26314d2', 'status': 'completed', 'code': 200} Dec 08 11:41:41.132471 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-77e5e6c1-2019-416d-b01a-5cff641b449a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:20Z', 'revision_number': 5, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:41.162474 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77e5e6c1-2019-416d-b01a-5cff641b449a None None] Checking router: e1280faa-8f3b-40a4-8270-5461288df246 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:41:41.170694 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77e5e6c1-2019-416d-b01a-5cff641b449a None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:41:41.171344 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-77e5e6c1-2019-416d-b01a-5cff641b449a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:41:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:41.277564 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-77e5e6c1-2019-416d-b01a-5cff641b449a None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:41:41.478974 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-77e5e6c1-2019-416d-b01a-5cff641b449a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:20Z', 'revision_number': 5, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:41.504961 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77e5e6c1-2019-416d-b01a-5cff641b449a None None] The sync data for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi is: [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:31:14Z', 'revision_number': 4, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3344a7ff-723b-43bf-afa4-716acfe3b78f', 'name': '', 'network_id': '185aeb08-41ef-4fae-a420-33296f710850', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'mac_address': 'fa:16:3e:ab:18:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:12Z', 'updated_at': '2021-12-08T11:31:20Z', 'revision_number': 5, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'subnets': [{'id': '40a584f7-ce77-4d89-87c2-4f3f589c6700', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:41:41.529174 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58866) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:41.584246 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-362f78df-7a81-4370-84b1-109da5244c6e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:41.607575 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-362f78df-7a81-4370-84b1-109da5244c6e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:41.656440 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-362f78df-7a81-4370-84b1-109da5244c6e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:41.659044 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-362f78df-7a81-4370-84b1-109da5244c6e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:41.660197 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-362f78df-7a81-4370-84b1-109da5244c6e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "DELETE /v2.0/security-groups/d942334b-e776-48d7-bdd4-04c6cf5975fa HTTP/1.1" status: 204 len: 168 time: 0.1299112 Dec 08 11:41:41.663372 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58868) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:41.669351 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-362f78df-7a81-4370-84b1-109da5244c6e tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d942334b-e776-48d7-bdd4-04c6cf5975fa,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:41.678098 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.api.v2.resource [None req-940a4df0-3850-4475-a2f3-2761e76b2cee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] show failed (client error): The resource could not be found. Dec 08 11:41:41.682649 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58870) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:41.682987 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-940a4df0-3850-4475-a2f3-2761e76b2cee tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "GET /v2.0/security-groups/d942334b-e776-48d7-bdd4-04c6cf5975fa HTTP/1.1" status: 404 len: 347 time: 0.0183437 Dec 08 11:41:41.734488 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b564ed8-ba2b-4eeb-804f-be3c59b1aec5 None None] New status for floating IP e2179aba-a80b-4ecc-a7cd-65324ecfe007: DOWN {{(pid=102320) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:41:41.808426 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-a3947a3f-3ff6-4df5-8b5e-c1c6aa8c9609 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Deleting port 8705750a-043c-420a-8fe5-569519383376 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:41.808761 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a3947a3f-3ff6-4df5-8b5e-c1c6aa8c9609 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:41.889858 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a3947a3f-3ff6-4df5-8b5e-c1c6aa8c9609 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:41.890184 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a3947a3f-3ff6-4df5-8b5e-c1c6aa8c9609 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:41.901538 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-a3947a3f-3ff6-4df5-8b5e-c1c6aa8c9609 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Calling delete_port for 8705750a-043c-420a-8fe5-569519383376 owned by network:floatingip {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:42.029112 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a3947a3f-3ff6-4df5-8b5e-c1c6aa8c9609 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:42.055128 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3947a3f-3ff6-4df5-8b5e-c1c6aa8c9609 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Pushing event deleted for resources: {'Port': ['ID=8705750a-043c-420a-8fe5-569519383376,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:42.114120 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a3947a3f-3ff6-4df5-8b5e-c1c6aa8c9609 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks [] for floatingip, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:42.116611 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a3947a3f-3ff6-4df5-8b5e-c1c6aa8c9609 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:42.118370 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-a3947a3f-3ff6-4df5-8b5e-c1c6aa8c9609 tempest-AttachVolumeTestJSON-473861303 tempest-AttachVolumeTestJSON-473861303-project] 10.222.0.66 "DELETE /v2.0/floatingips/e2179aba-a80b-4ecc-a7cd-65324ecfe007 HTTP/1.1" status: 204 len: 168 time: 0.4342101 Dec 08 11:41:42.543127 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 973b8088-0638-45a6-9fe0-acffa26314d2 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:41:42.563185 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 973b8088-0638-45a6-9fe0-acffa26314d2 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:41:42.563537 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 973b8088-0638-45a6-9fe0-acffa26314d2 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:41:45.628592 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58898) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:46.109030 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2601c730-3cf9-46e1-aa2e-58d8a55b585e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7897011'] for router_interface, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:46.345007 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-2601c730-3cf9-46e1-aa2e-58d8a55b585e admin admin] Deleting port 3344a7ff-723b-43bf-afa4-716acfe3b78f {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:46.345286 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2601c730-3cf9-46e1-aa2e-58d8a55b585e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:46.418585 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-2601c730-3cf9-46e1-aa2e-58d8a55b585e admin admin] For port 3344a7ff-723b-43bf-afa4-716acfe3b78f, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=3344a7ff-723b-43bf-afa4-716acfe3b78f,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:46.418937 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2601c730-3cf9-46e1-aa2e-58d8a55b585e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:46.430758 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-2601c730-3cf9-46e1-aa2e-58d8a55b585e admin admin] Calling delete_port for 3344a7ff-723b-43bf-afa4-716acfe3b78f owned by network:router_interface {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:46.600843 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2601c730-3cf9-46e1-aa2e-58d8a55b585e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:46.622814 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2601c730-3cf9-46e1-aa2e-58d8a55b585e admin admin] Pushing event deleted for resources: {'Port': ['ID=3344a7ff-723b-43bf-afa4-716acfe3b78f,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:47.041905 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2601c730-3cf9-46e1-aa2e-58d8a55b585e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8074906', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7896871'] for router_interface, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:47.250169 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2601c730-3cf9-46e1-aa2e-58d8a55b585e admin admin] Router e1280faa-8f3b-40a4-8270-5461288df246 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:41:47.349434 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2601c730-3cf9-46e1-aa2e-58d8a55b585e admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:41:47.355067 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-2601c730-3cf9-46e1-aa2e-58d8a55b585e admin admin] 10.222.0.66 "PUT /v2.0/routers/e1280faa-8f3b-40a4-8270-5461288df246/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7254069 Dec 08 11:41:47.357534 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58904) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:47.360204 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a7ce38e-7b9c-4f2c-aa45-b3e2c4600c6d None None] Sync routers for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:41:47.370786 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a7ce38e-7b9c-4f2c-aa45-b3e2c4600c6d None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:41:47.371467 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-0a7ce38e-7b9c-4f2c-aa45-b3e2c4600c6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:41:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:47.458565 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Publish callbacks [] for router, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:47.474299 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-0a7ce38e-7b9c-4f2c-aa45-b3e2c4600c6d None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:41:47.560849 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:47.611984 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Deleting port b7ef0c25-a20a-4d35-9d9c-c024cd837ede {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:47.612211 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:47.649660 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-0a7ce38e-7b9c-4f2c-aa45-b3e2c4600c6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166'}], 'enable_snat': True}, 'gw_port_id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:41:46Z', 'revision_number': 5, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port': {'id': 'b7ef0c25-a20a-4d35-9d9c-c024cd837ede', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:4e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.166', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:47.684112 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a7ce38e-7b9c-4f2c-aa45-b3e2c4600c6d None None] Checking router: e1280faa-8f3b-40a4-8270-5461288df246 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:41:47.698913 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:47.700026 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a7ce38e-7b9c-4f2c-aa45-b3e2c4600c6d None None] Routers {'e1280faa-8f3b-40a4-8270-5461288df246'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:41:47.700627 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-0a7ce38e-7b9c-4f2c-aa45-b3e2c4600c6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:41:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['e1280faa-8f3b-40a4-8270-5461288df246'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:47.704224 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] For port b7ef0c25-a20a-4d35-9d9c-c024cd837ede, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=b7ef0c25-a20a-4d35-9d9c-c024cd837ede,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:47.704585 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:47.717388 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Calling delete_port for b7ef0c25-a20a-4d35-9d9c-c024cd837ede owned by network:router_gateway {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:47.882000 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:47.908149 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Pushing event deleted for resources: {'Port': ['ID=b7ef0c25-a20a-4d35-9d9c-c024cd837ede,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:47.912935 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-0a7ce38e-7b9c-4f2c-aa45-b3e2c4600c6d None None] Set router e1280faa-8f3b-40a4-8270-5461288df246 gateway port host: None {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:41:47.965609 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-0a7ce38e-7b9c-4f2c-aa45-b3e2c4600c6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:41:47Z', 'revision_number': 6, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port_host': None}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:47.971955 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7889737'] for router_gateway, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:47.995155 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a7ce38e-7b9c-4f2c-aa45-b3e2c4600c6d None None] The sync data for ids ['e1280faa-8f3b-40a4-8270-5461288df246'] in dv-cinder-819778-3-iscsi is: [{'id': 'e1280faa-8f3b-40a4-8270-5461288df246', 'name': 'tempest-AttachVolumeTestJSON-549518292-router', 'tenant_id': '9c60094b48d34489b46e92ae73d7e33a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:06Z', 'updated_at': '2021-12-08T11:41:47Z', 'revision_number': 6, 'project_id': '9c60094b48d34489b46e92ae73d7e33a', 'gw_port_host': None}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:41:48.060270 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7895253', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32185'] for router, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.062389 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.105891 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7895086'] for router, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.106418 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Fanout notify agent at l3_agent the message router_deleted on router e1280faa-8f3b-40a4-8270-5461288df246 {{(pid=102318) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 08 11:41:48.110740 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] Publish callbacks [] for router, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.111916 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-8dadae70-59ad-471e-9e05-84addc7f703f admin admin] 10.222.0.66 "DELETE /v2.0/routers/e1280faa-8f3b-40a4-8270-5461288df246 HTTP/1.1" status: 204 len: 168 time: 0.7534344 Dec 08 11:41:48.114359 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58906) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:48.158159 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_v2 [None req-fe59a5cb-d76c-4f8a-a445-2f2a6c8e55a2 admin admin] Deleting subnet 40a584f7-ce77-4d89-87c2-4f3f589c6700 {{(pid=102318) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:41:48.161072 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fe59a5cb-d76c-4f8a-a445-2f2a6c8e55a2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.194107 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fe59a5cb-d76c-4f8a-a445-2f2a6c8e55a2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16370044'] for subnet, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.272379 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fe59a5cb-d76c-4f8a-a445-2f2a6c8e55a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.322512 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fe59a5cb-d76c-4f8a-a445-2f2a6c8e55a2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4572160', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-16496636'] for subnet, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.351998 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fe59a5cb-d76c-4f8a-a445-2f2a6c8e55a2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.356479 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-fe59a5cb-d76c-4f8a-a445-2f2a6c8e55a2 admin admin] 10.222.0.66 "DELETE /v2.0/subnets/40a584f7-ce77-4d89-87c2-4f3f589c6700 HTTP/1.1" status: 204 len: 168 time: 0.2407703 Dec 08 11:41:48.357373 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe59a5cb-d76c-4f8a-a445-2f2a6c8e55a2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=40a584f7-ce77-4d89-87c2-4f3f589c6700,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:48.358052 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd519d00-828a-4b7c-bb6e-ea1375f8cd56 None None] Network 185aeb08-41ef-4fae-a420-33296f710850 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:41:48.358864 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58908) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:48.433856 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.485728 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Deleting port 2f94307a-f496-4b83-80a6-634c4b525dde {{(pid=102317) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:48.486063 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.546936 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] For port 2f94307a-f496-4b83-80a6-634c4b525dde, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=2f94307a-f496-4b83-80a6-634c4b525dde,segment=NetworkSegment(432df489-4b9c-40d9-bda0-90c4bebb3b27),segment_id=432df489-4b9c-40d9-bda0-90c4bebb3b27)] {{(pid=102317) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:48.547285 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.559570 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Calling delete_port for 2f94307a-f496-4b83-80a6-634c4b525dde owned by network:dhcp {{(pid=102317) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:48.777484 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] DHCP port deletion for 185aeb08-41ef-4fae-a420-33296f710850 request from dv-cinder-819778-3-iscsi {{(pid=102319) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 08 11:41:48.830594 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.832940 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Deleting port 2f94307a-f496-4b83-80a6-634c4b525dde {{(pid=102319) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:41:48.833404 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.845924 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 2f94307a-f496-4b83-80a6-634c4b525dde no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:41:48.858704 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Pushing event deleted for resources: {'Port': ['ID=2f94307a-f496-4b83-80a6-634c4b525dde,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:48.860505 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] No DVR routers for this DVR port 2f94307a-f496-4b83-80a6-634c4b525dde on host dv-cinder-819778-3-iscsi {{(pid=102317) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:41:48.897436 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 2f94307a-f496-4b83-80a6-634c4b525dde {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:41:48.897775 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 2f94307a-f496-4b83-80a6-634c4b525dde not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:41:48.898190 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device b7ef0c25-a20a-4d35-9d9c-c024cd837ede no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:41:48.926980 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: b7ef0c25-a20a-4d35-9d9c-c024cd837ede {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:41:48.927325 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device b7ef0c25-a20a-4d35-9d9c-c024cd837ede not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:41:48.927735 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 3344a7ff-723b-43bf-afa4-716acfe3b78f no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:41:48.937430 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.954154 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] For port 2f94307a-f496-4b83-80a6-634c4b525dde, host dv-cinder-819778-3-iscsi, got binding levels [] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:41:48.954564 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.956739 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['185aeb08-41ef-4fae-a420-33296f710850']}} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:48.956858 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 3344a7ff-723b-43bf-afa4-716acfe3b78f {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:41:48.957078 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 3344a7ff-723b-43bf-afa4-716acfe3b78f not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:41:48.968349 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '432df489-4b9c-40d9-bda0-90c4bebb3b27') {'for_net_delete': True} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:48.968609 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Calling delete_port for 2f94307a-f496-4b83-80a6-634c4b525dde owned by network:dhcp {{(pid=102319) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:41:48.968704 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '432df489-4b9c-40d9-bda0-90c4bebb3b27') {} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:41:48.971485 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.ipam_backend_mixin [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Port 2f94307a-f496-4b83-80a6-634c4b525dde was not found and therefore no delete operation was performed {{(pid=102319) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 08 11:41:48.972702 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737'] for port, after_delete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.979991 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4850398'] for segment, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.995334 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:48.998575 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Pushing event deleted for resources: {'Port': ['ID=2f94307a-f496-4b83-80a6-634c4b525dde,revision_number=None']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:49.001720 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Releasing vlan 296 on physical network physnet1 to pool {{(pid=102317) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:41:49.002184 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5648505'] for segment, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:49.006281 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] No DVR routers for this DVR port 2f94307a-f496-4b83-80a6-634c4b525dde on host dv-cinder-819778-3-iscsi {{(pid=102319) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:41:49.008653 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:49.009007 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:49.009377 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:49.009711 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:49.010157 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:49.010484 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:49.010828 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:49.011137 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:49.011451 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:49.011770 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:49.012367 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:49.012687 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:49.013002 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1f2ed299-f197-41ff-a95c-ecffe1bcfe5b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: Traceback (most recent call last): Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: timer() Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: cb(*args, **kw) Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: return func(*args, **kwargs) Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: self._notify() Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: self.callback(batched_events) Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: event.method(event) Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: return f(self, *a, **k) Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._get(url).json() Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: return self.request(url, 'GET', **kwargs) Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:41:49.044562 dv-cinder-819778-3-iscsi neutron-server[102317]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:41:49.064072 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:49.069747 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:49.072969 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] 10.222.0.66 "DELETE /v2.0/networks/185aeb08-41ef-4fae-a420-33296f710850 HTTP/1.1" status: 204 len: 168 time: 0.7131259 Dec 08 11:41:49.088011 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-356e5653-8cdc-4744-b453-2b0d14a177a0 admin admin] Pushing event deleted for resources: {'Network': ['ID=185aeb08-41ef-4fae-a420-33296f710850,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:49.201194 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 58912) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:49.244945 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-7271a93d-6008-4407-bdcd-b1ce9598892e admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=9c60094b48d34489b46e92ae73d7e33a&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0423782 Dec 08 11:41:49.247405 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 58914) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:49.295230 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a095a24e-6c21-4f43-ac55-5e984292086c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:49.319318 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a095a24e-6c21-4f43-ac55-5e984292086c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:49.364059 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a095a24e-6c21-4f43-ac55-5e984292086c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:49.366746 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-a095a24e-6c21-4f43-ac55-5e984292086c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:49.367902 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-a095a24e-6c21-4f43-ac55-5e984292086c admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/a75e13bf-0367-4e19-987a-3dc5a4bb7d78 HTTP/1.1" status: 204 len: 168 time: 0.1195059 Dec 08 11:41:49.375223 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a095a24e-6c21-4f43-ac55-5e984292086c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a75e13bf-0367-4e19-987a-3dc5a4bb7d78,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:52.485338 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fb069587-354f-489f-87a0-2f2c43ea2e43 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:54.709637 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-15ff0c6d-1af4-44df-a334-8dec76c0cce6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:55.813938 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:57.165129 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:58.170003 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:58.622487 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59030) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:58.724068 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2d0404d9-d309-4209-94ce-228f78a40307 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:58.794130 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2d0404d9-d309-4209-94ce-228f78a40307 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:58.798321 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2d0404d9-d309-4209-94ce-228f78a40307 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:58.836973 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-2d0404d9-d309-4209-94ce-228f78a40307 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=32aef99c028d4fb1b6ad94bc103394c0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2133961 Dec 08 11:41:58.837860 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d0404d9-d309-4209-94ce-228f78a40307 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=544b6d91-2e8d-4dae-8dcd-1ec6a2601863,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:41:58.839932 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59034) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:41:58.890282 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-169db594-6783-4d8b-b29a-f64a97b050a2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:58.910366 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-169db594-6783-4d8b-b29a-f64a97b050a2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:58.955939 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-169db594-6783-4d8b-b29a-f64a97b050a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:58.959076 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-169db594-6783-4d8b-b29a-f64a97b050a2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:41:58.960232 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-169db594-6783-4d8b-b29a-f64a97b050a2 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/544b6d91-2e8d-4dae-8dcd-1ec6a2601863 HTTP/1.1" status: 204 len: 168 time: 0.1189063 Dec 08 11:41:58.968007 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-169db594-6783-4d8b-b29a-f64a97b050a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=544b6d91-2e8d-4dae-8dcd-1ec6a2601863,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:00.658832 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59096) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:00.760046 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4da3252a-8acd-4fe9-af5b-2b20bdaadd27 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:00.834464 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4da3252a-8acd-4fe9-af5b-2b20bdaadd27 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:00.838601 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4da3252a-8acd-4fe9-af5b-2b20bdaadd27 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:00.875203 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4da3252a-8acd-4fe9-af5b-2b20bdaadd27 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14500b07-25e4-46f7-a879-33d2472a1dbd,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:00.880373 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-4da3252a-8acd-4fe9-af5b-2b20bdaadd27 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=8a985ee1de9a402e8ec029c062d1d57c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2204461 Dec 08 11:42:00.883493 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59100) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:00.932280 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-021c60bf-701f-4e84-91b1-28421288020d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:00.952813 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-021c60bf-701f-4e84-91b1-28421288020d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:00.997729 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-021c60bf-701f-4e84-91b1-28421288020d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:01.000304 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-021c60bf-701f-4e84-91b1-28421288020d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:01.001466 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-021c60bf-701f-4e84-91b1-28421288020d admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/14500b07-25e4-46f7-a879-33d2472a1dbd HTTP/1.1" status: 204 len: 168 time: 0.1170490 Dec 08 11:42:01.009730 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-021c60bf-701f-4e84-91b1-28421288020d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14500b07-25e4-46f7-a879-33d2472a1dbd,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:01.253139 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59108) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:01.267042 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fd38e54b-22db-4b95-9bd2-4a180c3216a0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:01.338244 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fd38e54b-22db-4b95-9bd2-4a180c3216a0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:01.342023 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-fd38e54b-22db-4b95-9bd2-4a180c3216a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:01.379731 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-fd38e54b-22db-4b95-9bd2-4a180c3216a0 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=429f3c9680484ceb88c5e9ae66e6c3be&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1253824 Dec 08 11:42:01.380840 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd38e54b-22db-4b95-9bd2-4a180c3216a0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c8de4e71-1b3c-4e42-b58f-0c3450ec9a4b,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:01.382499 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59110) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:01.430437 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0b879827-9c39-40da-b24a-a0fcb9622c4e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:01.451054 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0b879827-9c39-40da-b24a-a0fcb9622c4e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:01.497323 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0b879827-9c39-40da-b24a-a0fcb9622c4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:01.500013 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0b879827-9c39-40da-b24a-a0fcb9622c4e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:01.501102 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-0b879827-9c39-40da-b24a-a0fcb9622c4e admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/c8de4e71-1b3c-4e42-b58f-0c3450ec9a4b HTTP/1.1" status: 204 len: 168 time: 0.1176119 Dec 08 11:42:01.510190 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b879827-9c39-40da-b24a-a0fcb9622c4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c8de4e71-1b3c-4e42-b58f-0c3450ec9a4b,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:07.065336 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59194) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:07.167584 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-92107636-11e9-425c-9b25-495595c2201b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.238836 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-92107636-11e9-425c-9b25-495595c2201b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.242247 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-92107636-11e9-425c-9b25-495595c2201b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.281469 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-92107636-11e9-425c-9b25-495595c2201b admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=273b47fb64ad403b875b4e265d7db880&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2150187 Dec 08 11:42:07.283403 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92107636-11e9-425c-9b25-495595c2201b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b416c222-2498-45a0-a2cc-54a58d85cd11,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:07.284187 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59198) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:07.334145 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.355647 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.401360 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.403882 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.404997 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/b416c222-2498-45a0-a2cc-54a58d85cd11 HTTP/1.1" status: 204 len: 168 time: 0.1198325 Dec 08 11:42:07.414088 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b416c222-2498-45a0-a2cc-54a58d85cd11,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:07.421495 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:07.421868 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:07.422186 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:07.422527 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:07.422861 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:07.423193 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:07.423556 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:07.423887 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:07.424213 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:07.424542 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:07.424890 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:07.425234 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:07.425560 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3322af8-ed6e-4ab4-8658-c72adceb36fe admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:07.655139 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59204) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:07.669672 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-572011a7-5860-484a-8e90-9605dad38cd1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.743374 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-572011a7-5860-484a-8e90-9605dad38cd1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.747105 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-572011a7-5860-484a-8e90-9605dad38cd1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.785315 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-572011a7-5860-484a-8e90-9605dad38cd1 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=60f9097edb924607877b1b4b5af8e11a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1290631 Dec 08 11:42:07.786168 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-572011a7-5860-484a-8e90-9605dad38cd1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb16e741-7889-4063-af03-a2cd47de4504,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:07.789368 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59206) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:07.836884 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-10e0050f-f6eb-4c92-831d-cd050dcaa640 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.858254 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-10e0050f-f6eb-4c92-831d-cd050dcaa640 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.904461 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-10e0050f-f6eb-4c92-831d-cd050dcaa640 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.907102 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-10e0050f-f6eb-4c92-831d-cd050dcaa640 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:07.908238 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-10e0050f-f6eb-4c92-831d-cd050dcaa640 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/cb16e741-7889-4063-af03-a2cd47de4504 HTTP/1.1" status: 204 len: 168 time: 0.1173406 Dec 08 11:42:07.916456 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10e0050f-f6eb-4c92-831d-cd050dcaa640 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb16e741-7889-4063-af03-a2cd47de4504,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:11.890333 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:42:17.701127 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:18.327337 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59316) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:18.428540 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-9d71aa48-093e-453a-ae68-5070e4c003d5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:18.500434 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-9d71aa48-093e-453a-ae68-5070e4c003d5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:18.503910 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-9d71aa48-093e-453a-ae68-5070e4c003d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:18.542875 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-9d71aa48-093e-453a-ae68-5070e4c003d5 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=c8623f62d66f4a36a5418a7cf9bbae0c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2145057 Dec 08 11:42:18.543739 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d71aa48-093e-453a-ae68-5070e4c003d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d524038-8d9f-4c7d-8e13-b65b834bc198,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:18.546457 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59320) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:18.594935 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1c53fbc7-3294-4dfa-9ced-e567f0fba028 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:18.618774 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1c53fbc7-3294-4dfa-9ced-e567f0fba028 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:18.665197 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1c53fbc7-3294-4dfa-9ced-e567f0fba028 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:18.667762 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1c53fbc7-3294-4dfa-9ced-e567f0fba028 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:18.669067 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-1c53fbc7-3294-4dfa-9ced-e567f0fba028 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/2d524038-8d9f-4c7d-8e13-b65b834bc198 HTTP/1.1" status: 204 len: 168 time: 0.1211722 Dec 08 11:42:18.676742 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c53fbc7-3294-4dfa-9ced-e567f0fba028 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d524038-8d9f-4c7d-8e13-b65b834bc198,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:18.918665 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59326) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:18.935172 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e1b802a-6887-4594-9f7d-8fbb52129a9b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:19.006025 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e1b802a-6887-4594-9f7d-8fbb52129a9b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:19.009426 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e1b802a-6887-4594-9f7d-8fbb52129a9b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:19.046943 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-0e1b802a-6887-4594-9f7d-8fbb52129a9b admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=4598e7059c6744f3b2e272f29a7fd74e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1272352 Dec 08 11:42:19.047767 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e1b802a-6887-4594-9f7d-8fbb52129a9b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ab5a6c5-c28e-4614-b6ef-307f83e743cb,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:19.049692 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59328) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:19.098048 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3891a54f-a439-4c0e-addb-4dcf6f20d5a7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:19.118592 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3891a54f-a439-4c0e-addb-4dcf6f20d5a7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:19.165945 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3891a54f-a439-4c0e-addb-4dcf6f20d5a7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:19.168334 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3891a54f-a439-4c0e-addb-4dcf6f20d5a7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:19.172062 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-3891a54f-a439-4c0e-addb-4dcf6f20d5a7 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/7ab5a6c5-c28e-4614-b6ef-307f83e743cb HTTP/1.1" status: 204 len: 168 time: 0.1213663 Dec 08 11:42:19.179628 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3891a54f-a439-4c0e-addb-4dcf6f20d5a7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ab5a6c5-c28e-4614-b6ef-307f83e743cb,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:21.822577 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe200ad4-bf9d-4c24-96b6-c6a37226acd4 req-462e30ca-02a8-4e60-8ac9-ab1ed6f96077 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:42:21.824633 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fe200ad4-bf9d-4c24-96b6-c6a37226acd4 req-462e30ca-02a8-4e60-8ac9-ab1ed6f96077 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 947 time: 0.0542870 Dec 08 11:42:21.873825 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fe200ad4-bf9d-4c24-96b6-c6a37226acd4 req-67198c8f-4220-4d4a-b37c-38019528e6c1 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431697 Dec 08 11:42:22.487264 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-4cef93a6-99d3-41d0-8929-fe85ba95cc6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:22.999917 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dac6076-4514-4483-ba0f-6b7248f45548 req-0bda1a78-8fb8-43a2-a318-1b3cf4ca72c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:42:23.001433 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7dac6076-4514-4483-ba0f-6b7248f45548 req-0bda1a78-8fb8-43a2-a318-1b3cf4ca72c5 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 947 time: 0.0537882 Dec 08 11:42:23.050590 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7dac6076-4514-4483-ba0f-6b7248f45548 req-bd5626d9-6a33-4909-8abc-a60253c85197 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups?id=80c24f36-bbc4-45e3-bd16-0aa2125af2b2&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430596 Dec 08 11:42:23.073399 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59408) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:23.175523 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c07fc838-c87e-4365-a868-93a7cc4e81ba admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:23.287179 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c07fc838-c87e-4365-a868-93a7cc4e81ba admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:23.295611 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-1e72d750-64ce-4fae-98f5-01b29b08169b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:42:23.297045 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-1e72d750-64ce-4fae-98f5-01b29b08169b tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.61 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 947 time: 0.0772979 Dec 08 11:42:23.298095 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-c07fc838-c87e-4365-a868-93a7cc4e81ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:23.359846 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c07fc838-c87e-4365-a868-93a7cc4e81ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=965499af-0448-4fe7-ba42-8923cf6c5980,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:23.367178 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-c07fc838-c87e-4365-a868-93a7cc4e81ba admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=879aaf3e0bb0479aab76f9b30ced0674&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2919014 Dec 08 11:42:23.369765 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59412) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:23.419449 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:23.419719 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Deleting port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:42:23.419953 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:23.441630 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:23.490425 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:23.493350 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:23.494483 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/965499af-0448-4fe7-ba42-8923cf6c5980 HTTP/1.1" status: 204 len: 168 time: 0.1224027 Dec 08 11:42:23.505173 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=965499af-0448-4fe7-ba42-8923cf6c5980,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:23.513994 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:23.514341 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:23.514512 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] For port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:42:23.514682 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:23.515010 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:23.515118 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:23.515419 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:23.515643 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:23.516054 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:23.516283 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:23.516607 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:23.516925 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:23.517748 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:23.517748 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:23.517970 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e2557976-8d85-4123-a98e-072cd1ef228b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:42:23.687417 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:23.687772 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:23.688085 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Floating IP d3b3d246-d42e-4a15-8d8e-079dd448dd08 disassociated. External IP: 172.27.2.27, port: d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee. Dec 08 11:42:23.688421 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling delete_port for d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:42:23.821212 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:23.848255 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event deleted for resources: {'Port': ['ID=d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:23.962357 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:42:24.075397 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:42:24.093239 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f25eebce-5b93-48d6-bf68-2a3d4ff4cfeb None None] Sync routers for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:42:24.113376 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f25eebce-5b93-48d6-bf68-2a3d4ff4cfeb None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:42:24.113994 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-f25eebce-5b93-48d6-bf68-2a3d4ff4cfeb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:41:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:42:24.131353 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] No DVR routers for this DVR port d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:42:24.133901 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:24.137546 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d8ec7ac5-304f-4135-82d0-20ee177fd347 req-e2d901ba-a909-4111-b468-22993994af4c tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.61 "DELETE /v2.0/ports/d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee HTTP/1.1" status: 204 len: 173 time: 0.8298333 Dec 08 11:42:24.138001 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'name': 'network-vif-deleted', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:42:24.140275 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-065e5b04-63db-4672-a5f7-45f10c604d7f" -d '{"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-deleted", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:42:24.210803 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dc3f5725-d231-477a-b66e-e311f0d9aece req-a5c7e9be-d33e-4c8c-8b32-61c2c5608411 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/ports?device_id=20f4bc10-4a61-47a6-857a-48e682893ae3 HTTP/1.1" status: 200 len: 210 time: 0.0605059 Dec 08 11:42:24.228379 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:42:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4a76046d-f958-41c4-b5cd-9d7b528c71cf x-openstack-request-id: req-4a76046d-f958-41c4-b5cd-9d7b528c71cf {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:42:24.228507 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "20f4bc10-4a61-47a6-857a-48e682893ae3", "name": "network-vif-deleted", "tag": "d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:42:24.228780 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-4a76046d-f958-41c4-b5cd-9d7b528c71cf {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:42:24.229203 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '20f4bc10-4a61-47a6-857a-48e682893ae3', 'name': 'network-vif-deleted', 'tag': 'd139d5e4-0e6e-4a53-ab1e-54188d8dc4ee', 'status': 'completed', 'code': 200} Dec 08 11:42:24.251976 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-f25eebce-5b93-48d6-bf68-2a3d4ff4cfeb None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:42:24.471043 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-f25eebce-5b93-48d6-bf68-2a3d4ff4cfeb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:27Z', 'revision_number': 5, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:42:24.496614 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f25eebce-5b93-48d6-bf68-2a3d4ff4cfeb None None] Checking router: d1e1bffc-ba94-4ef3-b10a-203d4ed7519f for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:42:24.504795 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f25eebce-5b93-48d6-bf68-2a3d4ff4cfeb None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:42:24.505422 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-f25eebce-5b93-48d6-bf68-2a3d4ff4cfeb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:41:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:42:24.612240 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-f25eebce-5b93-48d6-bf68-2a3d4ff4cfeb None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:42:24.711263 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-07d3b1f5-c805-4563-a055-210635ac69ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:24.810182 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-f25eebce-5b93-48d6-bf68-2a3d4ff4cfeb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:27Z', 'revision_number': 5, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:42:24.840147 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f25eebce-5b93-48d6-bf68-2a3d4ff4cfeb None None] The sync data for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi is: [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:31:17Z', 'revision_number': 4, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '3ed90e59-4866-4e65-989d-ebfaacbd446e', 'name': '', 'network_id': 'fd37a1fc-3614-462b-92a2-b41260c949a2', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'mac_address': 'fa:16:3e:53:01:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_interface', 'standard_attr_id': 100, 'fixed_ips': [{'subnet_id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:14Z', 'updated_at': '2021-12-08T11:31:27Z', 'revision_number': 5, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'subnets': [{'id': '62551f0b-3202-4a06-842d-a67bd8fa187b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:42:25.082302 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e41ea9e9-e37a-4920-afe9-d0c765698422 None None] New status for floating IP d3b3d246-d42e-4a15-8d8e-079dd448dd08: DOWN {{(pid=102319) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:42:25.310236 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59474) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:25.364374 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f2a5de7d-f92c-4aa5-8ad8-e946a71dba4d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:25.388039 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f2a5de7d-f92c-4aa5-8ad8-e946a71dba4d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:25.434784 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f2a5de7d-f92c-4aa5-8ad8-e946a71dba4d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:25.437508 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f2a5de7d-f92c-4aa5-8ad8-e946a71dba4d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:25.438807 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-f2a5de7d-f92c-4aa5-8ad8-e946a71dba4d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "DELETE /v2.0/security-groups/80c24f36-bbc4-45e3-bd16-0aa2125af2b2 HTTP/1.1" status: 204 len: 168 time: 0.1274796 Dec 08 11:42:25.441553 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59476) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:25.452839 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2a5de7d-f92c-4aa5-8ad8-e946a71dba4d tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=80c24f36-bbc4-45e3-bd16-0aa2125af2b2,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:25.458407 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.api.v2.resource [None req-58e0620f-f616-4963-8d10-e5bf77354e79 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] show failed (client error): The resource could not be found. Dec 08 11:42:25.459700 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-58e0620f-f616-4963-8d10-e5bf77354e79 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "GET /v2.0/security-groups/80c24f36-bbc4-45e3-bd16-0aa2125af2b2 HTTP/1.1" status: 404 len: 347 time: 0.0169015 Dec 08 11:42:25.462775 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59478) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:25.589993 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-709e8ea9-22d5-4deb-8510-f8172eb22b73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Deleting port c77e1417-5298-41c2-b074-b7ab2015f218 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:42:25.590265 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-709e8ea9-22d5-4deb-8510-f8172eb22b73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:25.667705 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-709e8ea9-22d5-4deb-8510-f8172eb22b73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:25.668018 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-709e8ea9-22d5-4deb-8510-f8172eb22b73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:25.680598 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-709e8ea9-22d5-4deb-8510-f8172eb22b73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Calling delete_port for c77e1417-5298-41c2-b074-b7ab2015f218 owned by network:floatingip {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:42:25.807158 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-709e8ea9-22d5-4deb-8510-f8172eb22b73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:25.813307 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:25.836874 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-709e8ea9-22d5-4deb-8510-f8172eb22b73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Pushing event deleted for resources: {'Port': ['ID=c77e1417-5298-41c2-b074-b7ab2015f218,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:25.894485 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-709e8ea9-22d5-4deb-8510-f8172eb22b73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks [] for floatingip, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:25.897057 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-709e8ea9-22d5-4deb-8510-f8172eb22b73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:25.898237 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-709e8ea9-22d5-4deb-8510-f8172eb22b73 tempest-AttachVolumeShelveTestJSON-442801570 tempest-AttachVolumeShelveTestJSON-442801570-project] 10.222.0.66 "DELETE /v2.0/floatingips/d3b3d246-d42e-4a15-8d8e-079dd448dd08 HTTP/1.1" status: 204 len: 168 time: 0.4343693 Dec 08 11:42:26.735412 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:42:26.755614 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:42:26.755990 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device d139d5e4-0e6e-4a53-ab1e-54188d8dc4ee not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:42:27.170550 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:28.171804 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:28.325062 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59532) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:28.816051 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-d622b600-a290-4ad2-a551-1393bf1c2587 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7897011'] for router_interface, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:29.062339 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-d622b600-a290-4ad2-a551-1393bf1c2587 admin admin] Deleting port 3ed90e59-4866-4e65-989d-ebfaacbd446e {{(pid=102317) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:42:29.062569 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-d622b600-a290-4ad2-a551-1393bf1c2587 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:29.138773 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [None req-d622b600-a290-4ad2-a551-1393bf1c2587 admin admin] For port 3ed90e59-4866-4e65-989d-ebfaacbd446e, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=3ed90e59-4866-4e65-989d-ebfaacbd446e,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102317) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:42:29.139171 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-d622b600-a290-4ad2-a551-1393bf1c2587 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:29.151335 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-d622b600-a290-4ad2-a551-1393bf1c2587 admin admin] Calling delete_port for 3ed90e59-4866-4e65-989d-ebfaacbd446e owned by network:router_interface {{(pid=102317) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:42:29.329467 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-d622b600-a290-4ad2-a551-1393bf1c2587 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:29.359215 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d622b600-a290-4ad2-a551-1393bf1c2587 admin admin] Pushing event deleted for resources: {'Port': ['ID=3ed90e59-4866-4e65-989d-ebfaacbd446e,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:29.524663 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-d622b600-a290-4ad2-a551-1393bf1c2587 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8074906', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7896871'] for router_interface, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:29.736327 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d622b600-a290-4ad2-a551-1393bf1c2587 admin admin] Router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:42:29.838940 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d622b600-a290-4ad2-a551-1393bf1c2587 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:42:29.844293 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-d622b600-a290-4ad2-a551-1393bf1c2587 admin admin] 10.222.0.66 "PUT /v2.0/routers/d1e1bffc-ba94-4ef3-b10a-203d4ed7519f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5181835 Dec 08 11:42:29.846772 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59546) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:29.854293 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae3c914e-90c3-4f6e-8155-f4bd809c5f0c None None] Sync routers for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:42:29.864468 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae3c914e-90c3-4f6e-8155-f4bd809c5f0c None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:42:29.865220 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-ae3c914e-90c3-4f6e-8155-f4bd809c5f0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:42:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:42:29.961826 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Publish callbacks [] for router, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:30.064890 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-ae3c914e-90c3-4f6e-8155-f4bd809c5f0c None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:42:30.079070 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:30.141483 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Deleting port fb627125-0851-47a7-84b3-bf51972e7b44 {{(pid=102317) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:42:30.142065 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:30.238726 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] For port fb627125-0851-47a7-84b3-bf51972e7b44, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=fb627125-0851-47a7-84b3-bf51972e7b44,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102317) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:42:30.239081 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:30.251325 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-ae3c914e-90c3-4f6e-8155-f4bd809c5f0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186'}], 'enable_snat': True}, 'gw_port_id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:42:29Z', 'revision_number': 5, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port': {'id': 'fb627125-0851-47a7-84b3-bf51972e7b44', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:26:a3:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 84, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.186', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:31:09Z', 'updated_at': '2021-12-08T11:31:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:42:30.253513 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Calling delete_port for fb627125-0851-47a7-84b3-bf51972e7b44 owned by network:router_gateway {{(pid=102317) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:42:30.284138 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae3c914e-90c3-4f6e-8155-f4bd809c5f0c None None] Checking router: d1e1bffc-ba94-4ef3-b10a-203d4ed7519f for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:42:30.293263 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae3c914e-90c3-4f6e-8155-f4bd809c5f0c None None] Routers {'d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:42:30.294287 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-ae3c914e-90c3-4f6e-8155-f4bd809c5f0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:42:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:42:30.385673 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-ae3c914e-90c3-4f6e-8155-f4bd809c5f0c None None] Set router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f gateway port host: None {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:42:30.438958 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-ae3c914e-90c3-4f6e-8155-f4bd809c5f0c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:42:30Z', 'revision_number': 6, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port_host': None}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:42:30.452805 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:30.469220 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae3c914e-90c3-4f6e-8155-f4bd809c5f0c None None] The sync data for ids ['d1e1bffc-ba94-4ef3-b10a-203d4ed7519f'] in dv-cinder-819778-3-iscsi is: [{'id': 'd1e1bffc-ba94-4ef3-b10a-203d4ed7519f', 'name': 'tempest-AttachVolumeShelveTestJSON-237846723-router', 'tenant_id': '44406e332fd94f1a9dcd704577410a61', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:31:07Z', 'updated_at': '2021-12-08T11:42:30Z', 'revision_number': 6, 'project_id': '44406e332fd94f1a9dcd704577410a61', 'gw_port_host': None}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:42:30.479646 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Pushing event deleted for resources: {'Port': ['ID=fb627125-0851-47a7-84b3-bf51972e7b44,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:30.548370 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7889737'] for router_gateway, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:30.834319 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7895253', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32185'] for router, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:30.838275 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:30.885280 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7895086'] for router, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:30.886033 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Fanout notify agent at l3_agent the message router_deleted on router d1e1bffc-ba94-4ef3-b10a-203d4ed7519f {{(pid=102317) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 08 11:42:30.890731 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] Publish callbacks [] for router, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:30.892002 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-6c1f3ee8-3be3-49a5-b24d-8d40543e4f7b admin admin] 10.222.0.66 "DELETE /v2.0/routers/d1e1bffc-ba94-4ef3-b10a-203d4ed7519f HTTP/1.1" status: 204 len: 168 time: 1.0443113 Dec 08 11:42:30.894612 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59564) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:30.948824 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_v2 [None req-2f9f821e-f381-4249-b04f-2b554ca2a134 admin admin] Deleting subnet 62551f0b-3202-4a06-842d-a67bd8fa187b {{(pid=102317) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:42:30.951912 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2f9f821e-f381-4249-b04f-2b554ca2a134 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:30.985781 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2f9f821e-f381-4249-b04f-2b554ca2a134 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4850389'] for subnet, precommit_delete_associations {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.060168 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2f9f821e-f381-4249-b04f-2b554ca2a134 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.114951 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2f9f821e-f381-4249-b04f-2b554ca2a134 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5645791', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5419674'] for subnet, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.139365 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f9f821e-f381-4249-b04f-2b554ca2a134 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=62551f0b-3202-4a06-842d-a67bd8fa187b,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:31.142874 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-2f9f821e-f381-4249-b04f-2b554ca2a134 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.146091 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-2f9f821e-f381-4249-b04f-2b554ca2a134 admin admin] 10.222.0.66 "DELETE /v2.0/subnets/62551f0b-3202-4a06-842d-a67bd8fa187b HTTP/1.1" status: 204 len: 168 time: 0.2503531 Dec 08 11:42:31.148698 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59566) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:31.149205 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e0e5cb0d-4d1e-4b34-9aeb-cbea6fe73193 None None] Network fd37a1fc-3614-462b-92a2-b41260c949a2 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:42:31.225825 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.246315 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 3ed90e59-4866-4e65-989d-ebfaacbd446e no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:42:31.273865 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 3ed90e59-4866-4e65-989d-ebfaacbd446e {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:42:31.274717 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 3ed90e59-4866-4e65-989d-ebfaacbd446e not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:42:31.308852 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Deleting port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de {{(pid=102317) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:42:31.309349 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.333795 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a9d721a-bf9a-4221-8ec4-e309803048e4 None None] DHCP port deletion for fd37a1fc-3614-462b-92a2-b41260c949a2 request from dv-cinder-819778-3-iscsi {{(pid=102319) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 08 11:42:31.384499 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] For port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=8295641e-b70d-4e0a-b8a8-b3d819b2a7de,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102317) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:42:31.384989 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.391588 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-5a9d721a-bf9a-4221-8ec4-e309803048e4 None None] Deleting port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de {{(pid=102319) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:42:31.391963 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-5a9d721a-bf9a-4221-8ec4-e309803048e4 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.400828 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Calling delete_port for 8295641e-b70d-4e0a-b8a8-b3d819b2a7de owned by network:dhcp {{(pid=102317) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:42:31.469066 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-5a9d721a-bf9a-4221-8ec4-e309803048e4 None None] For port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=8295641e-b70d-4e0a-b8a8-b3d819b2a7de,segment=NetworkSegment(394a978e-a69b-4e58-ad01-1710ac7a878b),segment_id=394a978e-a69b-4e58-ad01-1710ac7a878b)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:42:31.469732 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-5a9d721a-bf9a-4221-8ec4-e309803048e4 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.486879 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-5a9d721a-bf9a-4221-8ec4-e309803048e4 None None] Calling delete_port for 8295641e-b70d-4e0a-b8a8-b3d819b2a7de owned by network:dhcp {{(pid=102319) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:42:31.500027 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.525663 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59578) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:31.532607 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] No DVR routers for this DVR port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de on host dv-cinder-819778-3-iscsi {{(pid=102317) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:42:31.534346 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Pushing event deleted for resources: {'Port': ['ID=8295641e-b70d-4e0a-b8a8-b3d819b2a7de,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:31.582779 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-5a9d721a-bf9a-4221-8ec4-e309803048e4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737'] for port, after_delete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.596281 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a9d721a-bf9a-4221-8ec4-e309803048e4 None None] No DVR routers for this DVR port 8295641e-b70d-4e0a-b8a8-b3d819b2a7de on host dv-cinder-819778-3-iscsi {{(pid=102319) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:42:31.608830 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.632961 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a9d721a-bf9a-4221-8ec4-e309803048e4 None None] Pushing event deleted for resources: {'Port': ['ID=8295641e-b70d-4e0a-b8a8-b3d819b2a7de,revision_number=None']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:31.635472 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fd37a1fc-3614-462b-92a2-b41260c949a2']}} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:42:31.646440 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '394a978e-a69b-4e58-ad01-1710ac7a878b') {'for_net_delete': True} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:42:31.646785 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.services.segments.db [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '394a978e-a69b-4e58-ad01-1710ac7a878b') {} {{(pid=102317) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:42:31.656282 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4850398'] for segment, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.669598 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.675584 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Releasing vlan 278 on physical network physnet1 to pool {{(pid=102317) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:42:31.675987 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5648505'] for segment, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.677336 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3fe115b2-0117-454c-91cd-3603ce5bd245 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: Traceback (most recent call last): Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: timer() Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: cb(*args, **kw) Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: return func(*args, **kwargs) Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: self._notify() Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: self.callback(batched_events) Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: event.method(event) Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: return f(self, *a, **k) Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._get(url).json() Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: return self.request(url, 'GET', **kwargs) Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:42:31.677768 dv-cinder-819778-3-iscsi neutron-server[102317]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:42:31.737395 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.744263 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.748834 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] 10.222.0.66 "DELETE /v2.0/networks/fd37a1fc-3614-462b-92a2-b41260c949a2 HTTP/1.1" status: 204 len: 168 time: 0.5991611 Dec 08 11:42:31.759639 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e841311f-282a-4742-9f10-9a84a01297b8 admin admin] Pushing event deleted for resources: {'Network': ['ID=fd37a1fc-3614-462b-92a2-b41260c949a2,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:31.760015 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3fe115b2-0117-454c-91cd-3603ce5bd245 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.767042 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3fe115b2-0117-454c-91cd-3603ce5bd245 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.803710 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fe115b2-0117-454c-91cd-3603ce5bd245 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f034d05-fa8d-4b28-b604-7cd2c460a944,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:31.808510 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-3fe115b2-0117-454c-91cd-3603ce5bd245 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=b61139afddb0450c847a76cb2fd7c6fb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2804945 Dec 08 11:42:31.811260 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59584) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:31.862702 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-ec4bde2a-8897-4710-b25a-e7a12b382b4e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.867360 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59586) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:31.884595 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-ec4bde2a-8897-4710-b25a-e7a12b382b4e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.908351 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-9a6472d6-b555-4414-a72e-1075eb2f1138 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=44406e332fd94f1a9dcd704577410a61&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0397682 Dec 08 11:42:31.910919 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59588) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:31.940186 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-ec4bde2a-8897-4710-b25a-e7a12b382b4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.942820 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-ec4bde2a-8897-4710-b25a-e7a12b382b4e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.943989 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-ec4bde2a-8897-4710-b25a-e7a12b382b4e admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/5f034d05-fa8d-4b28-b604-7cd2c460a944 HTTP/1.1" status: 204 len: 168 time: 0.1317823 Dec 08 11:42:31.952258 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec4bde2a-8897-4710-b25a-e7a12b382b4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f034d05-fa8d-4b28-b604-7cd2c460a944,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:31.961993 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4484fe7d-488b-42dd-b4a9-c484ab65e683 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:31.991066 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4484fe7d-488b-42dd-b4a9-c484ab65e683 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:32.037411 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4484fe7d-488b-42dd-b4a9-c484ab65e683 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:32.040126 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-4484fe7d-488b-42dd-b4a9-c484ab65e683 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:32.041402 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-4484fe7d-488b-42dd-b4a9-c484ab65e683 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/5844f054-16cb-4dc7-b4ab-715d3455ebb8 HTTP/1.1" status: 204 len: 168 time: 0.1295261 Dec 08 11:42:32.050871 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4484fe7d-488b-42dd-b4a9-c484ab65e683 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5844f054-16cb-4dc7-b4ab-715d3455ebb8,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:32.331961 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59604) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:32.345507 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-3649adbb-79d2-4a3d-bc74-65c82d77f5a4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:32.424134 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-3649adbb-79d2-4a3d-bc74-65c82d77f5a4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:32.427918 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-3649adbb-79d2-4a3d-bc74-65c82d77f5a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:32.469082 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-3649adbb-79d2-4a3d-bc74-65c82d77f5a4 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=c7005c94749f4dd498749b1330929dbc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1336048 Dec 08 11:42:32.469523 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59608) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:32.470164 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3649adbb-79d2-4a3d-bc74-65c82d77f5a4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=407b3599-6cff-4612-a2e5-3e65d8323515,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:32.522362 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-132641cd-7600-4ada-a66d-d4bd93636bc5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:32.544163 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-132641cd-7600-4ada-a66d-d4bd93636bc5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:32.596121 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-132641cd-7600-4ada-a66d-d4bd93636bc5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:32.598965 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-132641cd-7600-4ada-a66d-d4bd93636bc5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:32.600499 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-132641cd-7600-4ada-a66d-d4bd93636bc5 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/407b3599-6cff-4612-a2e5-3e65d8323515 HTTP/1.1" status: 204 len: 168 time: 0.1299207 Dec 08 11:42:32.610471 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-132641cd-7600-4ada-a66d-d4bd93636bc5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=407b3599-6cff-4612-a2e5-3e65d8323515,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:32.631503 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 8295641e-b70d-4e0a-b8a8-b3d819b2a7de no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:42:32.655933 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 8295641e-b70d-4e0a-b8a8-b3d819b2a7de {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:42:32.656284 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 8295641e-b70d-4e0a-b8a8-b3d819b2a7de not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:42:32.656927 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device fb627125-0851-47a7-84b3-bf51972e7b44 no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:42:32.683795 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: fb627125-0851-47a7-84b3-bf51972e7b44 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:42:32.684163 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device fb627125-0851-47a7-84b3-bf51972e7b44 not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:42:32.895836 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59626) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:32.909223 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-eb50fb09-e486-48c2-84d7-0e5ad0de0e03 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:32.985565 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-eb50fb09-e486-48c2-84d7-0e5ad0de0e03 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:32.990534 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-eb50fb09-e486-48c2-84d7-0e5ad0de0e03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:33.034053 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-eb50fb09-e486-48c2-84d7-0e5ad0de0e03 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=9cdc47354e9345c291bf54cba4d27e78&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1371157 Dec 08 11:42:33.036801 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59630) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:33.037051 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb50fb09-e486-48c2-84d7-0e5ad0de0e03 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37a04e46-39d6-472e-acf6-8a93dc411cb8,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:33.106987 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9c4d4c44-72f9-4675-9cc1-5da8dd5674a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:33.132067 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9c4d4c44-72f9-4675-9cc1-5da8dd5674a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:33.194747 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9c4d4c44-72f9-4675-9cc1-5da8dd5674a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:33.198771 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-9c4d4c44-72f9-4675-9cc1-5da8dd5674a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:33.200072 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-9c4d4c44-72f9-4675-9cc1-5da8dd5674a8 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/37a04e46-39d6-472e-acf6-8a93dc411cb8 HTTP/1.1" status: 204 len: 168 time: 0.1620374 Dec 08 11:42:33.212007 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c4d4c44-72f9-4675-9cc1-5da8dd5674a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37a04e46-39d6-472e-acf6-8a93dc411cb8,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:42.428063 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59784) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:42.540424 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-41411247-3dd6-4eb5-add7-a2e2871cf5f9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:42.620760 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-41411247-3dd6-4eb5-add7-a2e2871cf5f9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:42.624366 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-41411247-3dd6-4eb5-add7-a2e2871cf5f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:42.667818 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-41411247-3dd6-4eb5-add7-a2e2871cf5f9 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=8148f1bee5a845a49e5c8b47b7a727ba&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2386494 Dec 08 11:42:42.668923 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41411247-3dd6-4eb5-add7-a2e2871cf5f9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7eea62c2-3a90-4e2d-bd7b-cd9fb2e8f99c,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:42.670635 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59792) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:42.719167 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8cbe33f9-57c1-489b-8ddb-54def5cf1a1b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:42.739355 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8cbe33f9-57c1-489b-8ddb-54def5cf1a1b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:42.784859 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8cbe33f9-57c1-489b-8ddb-54def5cf1a1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:42.787455 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8cbe33f9-57c1-489b-8ddb-54def5cf1a1b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:42.788584 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-8cbe33f9-57c1-489b-8ddb-54def5cf1a1b admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/7eea62c2-3a90-4e2d-bd7b-cd9fb2e8f99c HTTP/1.1" status: 204 len: 168 time: 0.1169667 Dec 08 11:42:42.796299 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cbe33f9-57c1-489b-8ddb-54def5cf1a1b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7eea62c2-3a90-4e2d-bd7b-cd9fb2e8f99c,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:43.917776 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 59850) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:44.025015 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-09746823-d021-48b3-a820-824212440bf4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:44.099462 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-09746823-d021-48b3-a820-824212440bf4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:44.102728 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-09746823-d021-48b3-a820-824212440bf4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:44.141330 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-09746823-d021-48b3-a820-824212440bf4 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=96b0d3b679dc40ce99534613246c3b19&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2222979 Dec 08 11:42:44.143301 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09746823-d021-48b3-a820-824212440bf4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=12793b04-001d-4439-9b32-9a2d2afe745e,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:44.143965 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 59854) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:42:44.193959 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-137eb2f0-faab-4003-a003-89f0352ec8e5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:44.215085 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-137eb2f0-faab-4003-a003-89f0352ec8e5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:44.259628 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-137eb2f0-faab-4003-a003-89f0352ec8e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:44.262999 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-137eb2f0-faab-4003-a003-89f0352ec8e5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:44.264147 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-137eb2f0-faab-4003-a003-89f0352ec8e5 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/12793b04-001d-4439-9b32-9a2d2afe745e HTTP/1.1" status: 204 len: 168 time: 0.1191757 Dec 08 11:42:44.271898 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-137eb2f0-faab-4003-a003-89f0352ec8e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=12793b04-001d-4439-9b32-9a2d2afe745e,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:42:47.722773 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:48.889580 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:42:52.487558 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-71951967-d4f8-4f9f-907d-6468da9e9f7e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:54.713972 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-f00fc2c1-a19a-412a-929d-b593181629a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:55.816459 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:57.171483 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:42:58.176981 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:17.712749 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:22.490058 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-6d478f63-53bc-433e-87d2-c172dcc3f515 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:24.715752 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-431a95ee-8f01-4070-a34a-2ced0d9c3c2f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:25.818281 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:25.888677 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:43:27.174661 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:28.176950 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:29.222310 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 60280) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:29.326026 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:29.399902 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:29.403454 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:29.441487 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=af2aea2a59b04a0aa515aec30637fd66&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2181103 Dec 08 11:43:29.442350 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d59cc42-f0ab-47ef-a5e0-24b510f5e4bc,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:29.444161 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 60284) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:29.450005 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.450361 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.450709 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.451053 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.451382 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.451710 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.452039 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.452367 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.452694 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.453021 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.453372 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.453694 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.454013 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43695d9e-2efa-4c12-9b7f-2695eec6b58f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.490906 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:29.511504 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:29.557375 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:29.560621 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:29.561773 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/4d59cc42-f0ab-47ef-a5e0-24b510f5e4bc HTTP/1.1" status: 204 len: 168 time: 0.1165349 Dec 08 11:43:29.569072 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d59cc42-f0ab-47ef-a5e0-24b510f5e4bc,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:29.576677 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.577029 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.577404 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.577748 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.578078 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.578406 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.578733 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.579063 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.579382 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.579706 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.580030 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.580348 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.580665 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49e3c636-d8bf-47a6-a413-8e8fa5e6b1f4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:29.811379 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 60290) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:29.827054 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c09f74fa-7b7c-481b-9c35-74a318a0a22b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:29.901888 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c09f74fa-7b7c-481b-9c35-74a318a0a22b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:29.905727 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c09f74fa-7b7c-481b-9c35-74a318a0a22b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:29.944403 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-c09f74fa-7b7c-481b-9c35-74a318a0a22b admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=b6a6cccbdb484143a4e9766634a32205&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1319709 Dec 08 11:43:29.945333 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c09f74fa-7b7c-481b-9c35-74a318a0a22b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8bd5757f-f03c-4fb0-b154-29295d2c0ceb,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:29.947162 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 60294) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:29.998166 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cf97d721-08a0-4b5c-b2d7-970dbea37898 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:30.018481 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cf97d721-08a0-4b5c-b2d7-970dbea37898 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:30.063672 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cf97d721-08a0-4b5c-b2d7-970dbea37898 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:30.066527 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cf97d721-08a0-4b5c-b2d7-970dbea37898 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:30.067693 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-cf97d721-08a0-4b5c-b2d7-970dbea37898 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/8bd5757f-f03c-4fb0-b154-29295d2c0ceb HTTP/1.1" status: 204 len: 168 time: 0.1195164 Dec 08 11:43:30.075007 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf97d721-08a0-4b5c-b2d7-970dbea37898 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8bd5757f-f03c-4fb0-b154-29295d2c0ceb,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:31.615518 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 60340) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:31.718135 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-66a4f5e8-5f64-4748-9ec8-20ea54eb796b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:31.804187 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-66a4f5e8-5f64-4748-9ec8-20ea54eb796b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:31.808562 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-66a4f5e8-5f64-4748-9ec8-20ea54eb796b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:31.846412 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-66a4f5e8-5f64-4748-9ec8-20ea54eb796b admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=be35fa2247f74c36af896af87b11095f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2298176 Dec 08 11:43:31.848366 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66a4f5e8-5f64-4748-9ec8-20ea54eb796b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=43302a34-a436-4946-b4e9-47cc59db4cbd,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:31.849137 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 60344) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:31.903248 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-668941d6-93d0-4b7e-afd2-925ae58aef0e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:31.929484 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-668941d6-93d0-4b7e-afd2-925ae58aef0e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:31.976493 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-668941d6-93d0-4b7e-afd2-925ae58aef0e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:31.979140 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-668941d6-93d0-4b7e-afd2-925ae58aef0e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:31.980307 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-668941d6-93d0-4b7e-afd2-925ae58aef0e admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/43302a34-a436-4946-b4e9-47cc59db4cbd HTTP/1.1" status: 204 len: 168 time: 0.1301212 Dec 08 11:43:31.987678 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-668941d6-93d0-4b7e-afd2-925ae58aef0e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=43302a34-a436-4946-b4e9-47cc59db4cbd,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:32.234459 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 60352) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:32.248020 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-36a499e8-7c2d-41f2-bdea-5d5c28fd8056 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:32.327179 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-36a499e8-7c2d-41f2-bdea-5d5c28fd8056 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:32.330814 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-36a499e8-7c2d-41f2-bdea-5d5c28fd8056 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:32.367819 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-36a499e8-7c2d-41f2-bdea-5d5c28fd8056 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=1069a732e0a049fba3fe92d629ca8047&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1323268 Dec 08 11:43:32.368923 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36a499e8-7c2d-41f2-bdea-5d5c28fd8056 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1e94c38-efba-4507-a99a-382d6e374a80,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:32.370525 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 60354) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:32.417525 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-ae0f36c7-ea35-490e-96bd-56e534bdca4e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:32.438181 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-ae0f36c7-ea35-490e-96bd-56e534bdca4e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:32.482473 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-ae0f36c7-ea35-490e-96bd-56e534bdca4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:32.485098 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-ae0f36c7-ea35-490e-96bd-56e534bdca4e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:32.486254 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-ae0f36c7-ea35-490e-96bd-56e534bdca4e admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/b1e94c38-efba-4507-a99a-382d6e374a80 HTTP/1.1" status: 204 len: 168 time: 0.1141596 Dec 08 11:43:32.493648 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae0f36c7-ea35-490e-96bd-56e534bdca4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1e94c38-efba-4507-a99a-382d6e374a80,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:38.657569 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 60508) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:38.760785 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7ccf8d0a-ac74-4010-b157-a4bf6402c7be admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:38.834840 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7ccf8d0a-ac74-4010-b157-a4bf6402c7be admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:38.838648 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-7ccf8d0a-ac74-4010-b157-a4bf6402c7be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:38.877084 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-7ccf8d0a-ac74-4010-b157-a4bf6402c7be admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=f563fabb0a214ba7b00da8212b644412&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2181642 Dec 08 11:43:38.877815 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ccf8d0a-ac74-4010-b157-a4bf6402c7be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c4442ec1-c6b2-496a-bec5-4a40120556a4,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:38.879824 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 60516) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:38.931028 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-78003cc8-d797-4d7e-8949-28a8cb7a5608 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:38.953553 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-78003cc8-d797-4d7e-8949-28a8cb7a5608 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:39.002337 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-78003cc8-d797-4d7e-8949-28a8cb7a5608 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:39.005015 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-78003cc8-d797-4d7e-8949-28a8cb7a5608 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:39.006188 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-78003cc8-d797-4d7e-8949-28a8cb7a5608 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/c4442ec1-c6b2-496a-bec5-4a40120556a4 HTTP/1.1" status: 204 len: 168 time: 0.1252997 Dec 08 11:43:39.014573 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78003cc8-d797-4d7e-8949-28a8cb7a5608 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c4442ec1-c6b2-496a-bec5-4a40120556a4,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:39.267182 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 60524) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:39.280284 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b25b64dd-4684-4fa7-b08d-2d35dd3eb1ef admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:39.352446 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b25b64dd-4684-4fa7-b08d-2d35dd3eb1ef admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:39.356015 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b25b64dd-4684-4fa7-b08d-2d35dd3eb1ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:39.397002 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-b25b64dd-4684-4fa7-b08d-2d35dd3eb1ef admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=3139419bf61644acb114ba3df63f614b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1287649 Dec 08 11:43:39.397861 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b25b64dd-4684-4fa7-b08d-2d35dd3eb1ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9c6a32d-f7eb-4d54-9e59-1e805c79f63a,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:39.400493 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 60526) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:39.448451 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-96d6c8b9-0192-4eda-b6f3-003d629a7697 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:39.469118 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-96d6c8b9-0192-4eda-b6f3-003d629a7697 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:39.515068 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-96d6c8b9-0192-4eda-b6f3-003d629a7697 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:39.517656 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-96d6c8b9-0192-4eda-b6f3-003d629a7697 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:39.518784 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-96d6c8b9-0192-4eda-b6f3-003d629a7697 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/c9c6a32d-f7eb-4d54-9e59-1e805c79f63a HTTP/1.1" status: 204 len: 168 time: 0.1169233 Dec 08 11:43:39.526000 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96d6c8b9-0192-4eda-b6f3-003d629a7697 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9c6a32d-f7eb-4d54-9e59-1e805c79f63a,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:40.195927 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 60558) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:40.298301 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-de3568f9-879e-4fc7-a7be-2b5c3c23726b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.374053 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-de3568f9-879e-4fc7-a7be-2b5c3c23726b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.378403 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-de3568f9-879e-4fc7-a7be-2b5c3c23726b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.418452 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-de3568f9-879e-4fc7-a7be-2b5c3c23726b admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=ef6b7f9bbc0741dfadc0553f191b9874&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2213795 Dec 08 11:43:40.420106 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de3568f9-879e-4fc7-a7be-2b5c3c23726b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd4889f4-9fea-4c21-832f-a37353c366cb,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:40.421601 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 60566) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:40.474176 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-03203022-d15a-4e89-823f-6aefd4eb2172 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.495282 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-03203022-d15a-4e89-823f-6aefd4eb2172 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.502924 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 60568) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:40.548113 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-03203022-d15a-4e89-823f-6aefd4eb2172 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.550958 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-03203022-d15a-4e89-823f-6aefd4eb2172 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.554728 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-03203022-d15a-4e89-823f-6aefd4eb2172 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/dd4889f4-9fea-4c21-832f-a37353c366cb HTTP/1.1" status: 204 len: 168 time: 0.1279650 Dec 08 11:43:40.560855 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03203022-d15a-4e89-823f-6aefd4eb2172 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd4889f4-9fea-4c21-832f-a37353c366cb,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:40.617886 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bd244111-8b13-4fe8-85d1-0a62f5d1c565 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.696561 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bd244111-8b13-4fe8-85d1-0a62f5d1c565 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.700615 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-bd244111-8b13-4fe8-85d1-0a62f5d1c565 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.738747 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-bd244111-8b13-4fe8-85d1-0a62f5d1c565 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=81e1e954aade4293892953e78f894806&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2348092 Dec 08 11:43:40.740914 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd244111-8b13-4fe8-85d1-0a62f5d1c565 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d119b0f-aaf5-49b9-93ca-3e151d443049,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:40.741474 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 60576) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:40.793354 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f1e9a3b8-65f7-4a5a-b59c-ed4f49eda5ee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.814704 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f1e9a3b8-65f7-4a5a-b59c-ed4f49eda5ee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.866589 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f1e9a3b8-65f7-4a5a-b59c-ed4f49eda5ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.869281 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-f1e9a3b8-65f7-4a5a-b59c-ed4f49eda5ee admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:40.873006 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-f1e9a3b8-65f7-4a5a-b59c-ed4f49eda5ee admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/5d119b0f-aaf5-49b9-93ca-3e151d443049 HTTP/1.1" status: 204 len: 168 time: 0.1278927 Dec 08 11:43:40.883390 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1e9a3b8-65f7-4a5a-b59c-ed4f49eda5ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d119b0f-aaf5-49b9-93ca-3e151d443049,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:42.921719 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-68391e52-c109-4e77-a22c-2399463d17e8 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/networks?tenant_id=6aba8d1c389c4b30b9e9d118d99c8c26&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0290868 Dec 08 11:43:43.105322 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ebb87445-bf50-4481-bd16-8e13526c1f6c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:43.107354 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ebb87445-bf50-4481-bd16-8e13526c1f6c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1797843 Dec 08 11:43:43.122246 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-0e6b71b8-ffe1-4cd4-8b32-b2bf1e8d3b1a tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/quotas/6aba8d1c389c4b30b9e9d118d99c8c26 HTTP/1.1" status: 200 len: 375 time: 0.0089858 Dec 08 11:43:43.428844 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-442a5735-9425-4946-82f2-1439723f8f83 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=6aba8d1c389c4b30b9e9d118d99c8c26&fields=id HTTP/1.1" status: 200 len: 210 time: 0.3009415 Dec 08 11:43:43.585653 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-751d2824-162d-4854-ad1e-b2696f23ae17 req-e289819e-c4d9-4a46-a56b-78c75973c02f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 210 time: 0.0259402 Dec 08 11:43:44.418731 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-d04f301d-f06e-4049-a036-138a517303bf tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.61 "GET /v2.0/networks?tenant_id=6aba8d1c389c4b30b9e9d118d99c8c26&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0208814 Dec 08 11:43:44.534017 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98780063-be02-42b1-a188-998b40b5a7e4 req-de520f9b-f066-4770-9a5f-e7eec9e1d288 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:44.535499 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-de520f9b-f066-4770-9a5f-e7eec9e1d288 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.61 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1099155 Dec 08 11:43:44.548820 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Request body: {'port': {'device_id': '93a3b4bc-2fd2-4906-b48d-8a83e07d267f', 'network_id': '7df8d427-89be-46db-a2a5-7e3b3b0f889a', 'admin_state_up': True, 'tenant_id': '6aba8d1c389c4b30b9e9d118d99c8c26'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:43:44.671146 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Made reservation on behalf of 6aba8d1c389c4b30b9e9d118d99c8c26 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:43:44.674741 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:44.696726 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ebce6b1a-6dc3-4e07-b19d-fa6dc382b9e9 req-0306842a-92e4-4c11-a8d3-e5fc875282c9 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 210 time: 0.0403702 Dec 08 11:43:44.697538 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:44.784517 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:44.788465 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:44.849642 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5084168f-27e0-4418-8c4b-2da9ecf304d3,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:44.922273 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Allocated IP 192.168.233.250 (7df8d427-89be-46db-a2a5-7e3b3b0f889a/12e62f95-2153-4a0a-85cc-741571dc715a/8e997973-70c0-4a18-88a4-6987a0a07c03) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:43:45.065856 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:45.098599 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:45.140312 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Network 7df8d427-89be-46db-a2a5-7e3b3b0f889a is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:43:45.145123 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:43:45.147713 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:43:45.177747 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Pushing event updated for resources: {'Port': ['ID=8e997973-70c0-4a18-88a4-6987a0a07c03,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:45.207738 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:45.208357 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:45.226537 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-ee37e8b9-4509-4c4b-a1c0-91f63fab7041 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.6817436 Dec 08 11:43:45.237180 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-9ae8f737-74e0-4058-b48f-cf66778319ba tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102318) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:43:45.238169 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-9ae8f737-74e0-4058-b48f-cf66778319ba tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0051992 Dec 08 11:43:45.359044 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Request body: {'port': {'device_id': '93a3b4bc-2fd2-4906-b48d-8a83e07d267f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:43:45.412684 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-6fa07206-3fb6-4fac-b7e1-002fdd675cbc None None] Provisioning complete for port 8e997973-70c0-4a18-88a4-6987a0a07c03 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:43:45.413367 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-6fa07206-3fb6-4fac-b7e1-002fdd675cbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:45.413990 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:45.447338 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-6fa07206-3fb6-4fac-b7e1-002fdd675cbc None None] Port 8e997973-70c0-4a18-88a4-6987a0a07c03 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:43:45.672901 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8e997973-70c0-4a18-88a4-6987a0a07c03 {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:43:45.680678 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:45.692990 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Transition to ACTIVE for port object 8e997973-70c0-4a18-88a4-6987a0a07c03 will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:43:45.696296 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:45.764107 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Pushing event updated for resources: {'Port': ['ID=8e997973-70c0-4a18-88a4-6987a0a07c03,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:45.860210 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e083da0-92b9-454d-a761-4341b0ce3720 req-5b6ead33-7b24-4dd1-8336-754b844dbe0c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:45.861782 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9e083da0-92b9-454d-a761-4341b0ce3720 req-5b6ead33-7b24-4dd1-8336-754b844dbe0c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 948 time: 0.0757813 Dec 08 11:43:45.863082 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Attempting to bind port 8e997973-70c0-4a18-88a4-6987a0a07c03 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:43:45.863417 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Attempting to bind port 8e997973-70c0-4a18-88a4-6987a0a07c03 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': 'e9f215c2-bfb7-4c9c-9387-63241407ac7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 299, 'network_id': '7df8d427-89be-46db-a2a5-7e3b3b0f889a'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:43:45.863747 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Attempting to bind port 8e997973-70c0-4a18-88a4-6987a0a07c03 on network 7df8d427-89be-46db-a2a5-7e3b3b0f889a {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:43:45.869876 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Port 8e997973-70c0-4a18-88a4-6987a0a07c03 on network 7df8d427-89be-46db-a2a5-7e3b3b0f889a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:43:45.870199 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Attempting to bind port 8e997973-70c0-4a18-88a4-6987a0a07c03 on network 7df8d427-89be-46db-a2a5-7e3b3b0f889a {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:43:45.888488 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 43, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:43:45.888831 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Checking segment: {'id': 'e9f215c2-bfb7-4c9c-9387-63241407ac7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 299, 'network_id': '7df8d427-89be-46db-a2a5-7e3b3b0f889a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:43:45.889280 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Bound using segment: {'id': 'e9f215c2-bfb7-4c9c-9387-63241407ac7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 299, 'network_id': '7df8d427-89be-46db-a2a5-7e3b3b0f889a'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:43:45.889684 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Bound port: 8e997973-70c0-4a18-88a4-6987a0a07c03, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e9f215c2-bfb7-4c9c-9387-63241407ac7e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 299, 'network_id': '7df8d427-89be-46db-a2a5-7e3b3b0f889a'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:43:45.890030 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:45.951664 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9e083da0-92b9-454d-a761-4341b0ce3720 req-eb5514b5-09a7-4cba-81ed-b105c660470c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/security-groups?id=5084168f-27e0-4418-8c4b-2da9ecf304d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0828025 Dec 08 11:43:45.984292 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] For port 8e997973-70c0-4a18-88a4-6987a0a07c03, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:43:45.984292 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] For port 8e997973-70c0-4a18-88a4-6987a0a07c03, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=8e997973-70c0-4a18-88a4-6987a0a07c03,segment=NetworkSegment(e9f215c2-bfb7-4c9c-9387-63241407ac7e),segment_id=e9f215c2-bfb7-4c9c-9387-63241407ac7e)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:43:45.984911 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:46.019854 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:46.020386 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:46.023219 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] 10.222.0.61 "PUT /v2.0/ports/8e997973-70c0-4a18-88a4-6987a0a07c03 HTTP/1.1" status: 200 len: 1098 time: 0.7744148 Dec 08 11:43:46.023219 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '93a3b4bc-2fd2-4906-b48d-8a83e07d267f', 'tag': '8e997973-70c0-4a18-88a4-6987a0a07c03'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:43:46.024464 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9b309bcf-6f61-4c78-a932-216d4036580a" -d '{"events": [{"name": "network-changed", "server_uuid": "93a3b4bc-2fd2-4906-b48d-8a83e07d267f", "tag": "8e997973-70c0-4a18-88a4-6987a0a07c03"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:43:46.051315 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05b2fc06-c46a-40d2-9408-d6f92700ad00 service neutron] Pushing event updated for resources: {'Port': ['ID=8e997973-70c0-4a18-88a4-6987a0a07c03,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:46.109094 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:43:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b89ee826-eeb6-472b-8b5b-44fa657d6188 x-openstack-request-id: req-b89ee826-eeb6-472b-8b5b-44fa657d6188 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:43:46.109437 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "93a3b4bc-2fd2-4906-b48d-8a83e07d267f", "tag": "8e997973-70c0-4a18-88a4-6987a0a07c03", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:43:46.109693 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-b89ee826-eeb6-472b-8b5b-44fa657d6188 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:43:46.110110 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '93a3b4bc-2fd2-4906-b48d-8a83e07d267f', 'tag': '8e997973-70c0-4a18-88a4-6987a0a07c03', 'status': 'completed', 'code': 200} Dec 08 11:43:46.130732 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98780063-be02-42b1-a188-998b40b5a7e4 req-1f6b8524-f75d-4f14-8fb3-fe0e3aeee232 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:46.132256 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-1f6b8524-f75d-4f14-8fb3-fe0e3aeee232 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=6aba8d1c389c4b30b9e9d118d99c8c26&device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 1101 time: 0.0589001 Dec 08 11:43:46.177979 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-d8c3cfff-d540-4b68-bb00-e002957ecb43 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.250&port_id=8e997973-70c0-4a18-88a4-6987a0a07c03 HTTP/1.1" status: 200 len: 217 time: 0.0362961 Dec 08 11:43:46.230846 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98780063-be02-42b1-a188-998b40b5a7e4 req-9c1358d7-91ef-4527-a829-aed84762e77a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:46.232887 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-9c1358d7-91ef-4527-a829-aed84762e77a service neutron] 10.222.0.61 "GET /v2.0/subnets?id=12e62f95-2153-4a0a-85cc-741571dc715a HTTP/1.1" status: 200 len: 843 time: 0.0479791 Dec 08 11:43:46.278799 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98780063-be02-42b1-a188-998b40b5a7e4 req-e2e438db-a982-422d-a432-c8ebe1145c26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:46.280289 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-e2e438db-a982-422d-a432-c8ebe1145c26 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7df8d427-89be-46db-a2a5-7e3b3b0f889a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0401442 Dec 08 11:43:46.385748 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-87ee80c3-e148-4f48-b7c7-8b5c0fdb5e6f service neutron] 10.222.0.61 "GET /v2.0/networks/7df8d427-89be-46db-a2a5-7e3b3b0f889a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0974753 Dec 08 11:43:46.479381 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-98780063-be02-42b1-a188-998b40b5a7e4 req-e6e5f4ad-04aa-411b-80da-e4fc8c0f8266 service neutron] 10.222.0.61 "GET /v2.0/networks/7df8d427-89be-46db-a2a5-7e3b3b0f889a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869625 Dec 08 11:43:46.562105 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b309bcf-6f61-4c78-a932-216d4036580a req-43cd58cf-19a3-4da8-b69e-e663b058d180 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:46.563612 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9b309bcf-6f61-4c78-a932-216d4036580a req-43cd58cf-19a3-4da8-b69e-e663b058d180 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=6aba8d1c389c4b30b9e9d118d99c8c26&device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 1101 time: 0.0420470 Dec 08 11:43:46.659587 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b309bcf-6f61-4c78-a932-216d4036580a req-5d42dcc8-ee0b-4254-8e01-da8d915408fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:46.661060 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9b309bcf-6f61-4c78-a932-216d4036580a req-5d42dcc8-ee0b-4254-8e01-da8d915408fb service neutron] 10.222.0.61 "GET /v2.0/networks?id=7df8d427-89be-46db-a2a5-7e3b3b0f889a HTTP/1.1" status: 200 len: 870 time: 0.0895174 Dec 08 11:43:46.707672 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9b309bcf-6f61-4c78-a932-216d4036580a req-5e563a79-31d3-4e72-9a4a-471bda1718e6 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.250&port_id=8e997973-70c0-4a18-88a4-6987a0a07c03 HTTP/1.1" status: 200 len: 217 time: 0.0387385 Dec 08 11:43:46.756459 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b309bcf-6f61-4c78-a932-216d4036580a req-46bfd348-7928-45b3-bd3b-f7a01a929bbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:46.761582 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9b309bcf-6f61-4c78-a932-216d4036580a req-46bfd348-7928-45b3-bd3b-f7a01a929bbb service neutron] 10.222.0.61 "GET /v2.0/subnets?id=12e62f95-2153-4a0a-85cc-741571dc715a HTTP/1.1" status: 200 len: 843 time: 0.0433857 Dec 08 11:43:46.805334 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b309bcf-6f61-4c78-a932-216d4036580a req-75adcd82-5a1a-4a16-ac0e-ec65c9e7ee79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:46.806726 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9b309bcf-6f61-4c78-a932-216d4036580a req-75adcd82-5a1a-4a16-ac0e-ec65c9e7ee79 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=7df8d427-89be-46db-a2a5-7e3b3b0f889a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0406282 Dec 08 11:43:46.898246 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9b309bcf-6f61-4c78-a932-216d4036580a req-1166a740-3910-4156-87fe-4ed535357da2 service neutron] 10.222.0.61 "GET /v2.0/networks/7df8d427-89be-46db-a2a5-7e3b3b0f889a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0844131 Dec 08 11:43:46.992002 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9b309bcf-6f61-4c78-a932-216d4036580a req-ac001e65-633f-42f4-a928-6646d1de97e3 service neutron] 10.222.0.61 "GET /v2.0/networks/7df8d427-89be-46db-a2a5-7e3b3b0f889a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847471 Dec 08 11:43:47.082559 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed33a1a-25b4-4a48-a88c-b3316016494b req-d6cd31fd-e944-4330-869f-bc314022eb83 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:47.084063 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1ed33a1a-25b4-4a48-a88c-b3316016494b req-d6cd31fd-e944-4330-869f-bc314022eb83 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 948 time: 0.0503366 Dec 08 11:43:47.136213 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1ed33a1a-25b4-4a48-a88c-b3316016494b req-3d46f0f7-0663-4934-93d6-7bfdd8ed862f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/security-groups?id=5084168f-27e0-4418-8c4b-2da9ecf304d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456145 Dec 08 11:43:47.729243 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:48.263426 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b059fd3b-a4d9-45ec-a0cc-816d8cf0ea3c req-ee8bc5a9-7cac-462c-9802-f0d60689b491 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:48.265095 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b059fd3b-a4d9-45ec-a0cc-816d8cf0ea3c req-ee8bc5a9-7cac-462c-9802-f0d60689b491 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 948 time: 0.0541649 Dec 08 11:43:48.312297 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b059fd3b-a4d9-45ec-a0cc-816d8cf0ea3c req-3ec38dd8-b3aa-41a9-a713-c1bff5b9b710 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/security-groups?id=5084168f-27e0-4418-8c4b-2da9ecf304d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408447 Dec 08 11:43:49.087484 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 8e997973-70c0-4a18-88a4-6987a0a07c03 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:43:49.187089 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 8e997973-70c0-4a18-88a4-6987a0a07c03, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=8e997973-70c0-4a18-88a4-6987a0a07c03,segment=NetworkSegment(e9f215c2-bfb7-4c9c-9387-63241407ac7e),segment_id=e9f215c2-bfb7-4c9c-9387-63241407ac7e)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:43:49.200545 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '8e997973-70c0-4a18-88a4-6987a0a07c03', 'network_id': '7df8d427-89be-46db-a2a5-7e3b3b0f889a', 'port_id': '8e997973-70c0-4a18-88a4-6987a0a07c03', 'mac_address': 'fa:16:3e:b8:58:1e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 299, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '12e62f95-2153-4a0a-85cc-741571dc715a', 'ip_address': '192.168.233.250'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:43:49.242037 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:49.254960 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8e997973-70c0-4a18-88a4-6987a0a07c03 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:43:49.274429 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 8e997973-70c0-4a18-88a4-6987a0a07c03, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=8e997973-70c0-4a18-88a4-6987a0a07c03,segment=NetworkSegment(e9f215c2-bfb7-4c9c-9387-63241407ac7e),segment_id=e9f215c2-bfb7-4c9c-9387-63241407ac7e)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:43:49.278120 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:49.328158 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=8e997973-70c0-4a18-88a4-6987a0a07c03,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:49.335151 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:49.335438 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:49.335779 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:49.336115 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:49.336447 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:49.336774 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:49.337100 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:49.337459 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:49.337798 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:49.338125 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:49.338446 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:49.338765 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:49.339324 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:43:49.427215 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a765e20-70cf-41fa-996e-655aba623302 req-ac9c8ce3-6dfc-4a4d-b0d3-424809dec01a tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:49.429085 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7a765e20-70cf-41fa-996e-655aba623302 req-ac9c8ce3-6dfc-4a4d-b0d3-424809dec01a tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 949 time: 0.0479956 Dec 08 11:43:49.478516 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7a765e20-70cf-41fa-996e-655aba623302 req-a7ceccf8-084d-4fc9-8c6e-c439fe2af5d9 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/security-groups?id=5084168f-27e0-4418-8c4b-2da9ecf304d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416150 Dec 08 11:43:49.636650 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['8e997973-70c0-4a18-88a4-6987a0a07c03'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:43:50.595625 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43997d44-b643-4dd1-97e0-320b6b05ebe8 req-458d1867-dc75-47c7-bffb-d894fd4a3b69 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:50.597089 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-43997d44-b643-4dd1-97e0-320b6b05ebe8 req-458d1867-dc75-47c7-bffb-d894fd4a3b69 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 949 time: 0.0513871 Dec 08 11:43:50.643651 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-43997d44-b643-4dd1-97e0-320b6b05ebe8 req-6212427c-6c32-4991-9c66-0bc790323bef tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/security-groups?id=5084168f-27e0-4418-8c4b-2da9ecf304d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399897 Dec 08 11:43:51.093765 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 8e997973-70c0-4a18-88a4-6987a0a07c03 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:43:51.142058 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 8e997973-70c0-4a18-88a4-6987a0a07c03 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:43:51.145912 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 8e997973-70c0-4a18-88a4-6987a0a07c03 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:43:51.146280 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:51.221950 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:51.243171 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '93a3b4bc-2fd2-4906-b48d-8a83e07d267f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8e997973-70c0-4a18-88a4-6987a0a07c03'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:43:51.245407 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b68ed7bd-3a60-4b33-aa88-bb73367a258f" -d '{"events": [{"server_uuid": "93a3b4bc-2fd2-4906-b48d-8a83e07d267f", "name": "network-vif-plugged", "status": "completed", "tag": "8e997973-70c0-4a18-88a4-6987a0a07c03"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:43:51.258253 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 8e997973-70c0-4a18-88a4-6987a0a07c03, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=8e997973-70c0-4a18-88a4-6987a0a07c03,segment=NetworkSegment(e9f215c2-bfb7-4c9c-9387-63241407ac7e),segment_id=e9f215c2-bfb7-4c9c-9387-63241407ac7e)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:43:51.261965 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:51.285647 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:43:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2b0484a7-4531-4ca7-8cbb-4cafd3fc4826 x-openstack-request-id: req-2b0484a7-4531-4ca7-8cbb-4cafd3fc4826 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:43:51.285936 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "93a3b4bc-2fd2-4906-b48d-8a83e07d267f", "name": "network-vif-plugged", "status": "completed", "tag": "8e997973-70c0-4a18-88a4-6987a0a07c03", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:43:51.286190 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-2b0484a7-4531-4ca7-8cbb-4cafd3fc4826 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:43:51.286577 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '93a3b4bc-2fd2-4906-b48d-8a83e07d267f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8e997973-70c0-4a18-88a4-6987a0a07c03', 'code': 200} Dec 08 11:43:51.312954 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=8e997973-70c0-4a18-88a4-6987a0a07c03,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:51.450928 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2265c6d-56bb-4f76-ba4c-80f410073dc9 req-95f42918-121e-48f9-a8c4-85fc4f1840e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:51.452479 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e2265c6d-56bb-4f76-ba4c-80f410073dc9 req-95f42918-121e-48f9-a8c4-85fc4f1840e2 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 1103 time: 0.0440879 Dec 08 11:43:51.497525 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e2265c6d-56bb-4f76-ba4c-80f410073dc9 req-26ddaef7-7816-4769-8456-b066e9558863 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=5084168f-27e0-4418-8c4b-2da9ecf304d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0371470 Dec 08 11:43:51.589404 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 60782) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:51.691311 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2538f1ae-77e9-45a3-bfb2-010f4ed76e9d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:51.782055 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70c23ba4-423d-4269-87b8-1f8c333292d3 req-ca47788e-5588-4f0c-98f9-7c2db8f5f178 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:51.783508 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-70c23ba4-423d-4269-87b8-1f8c333292d3 req-ca47788e-5588-4f0c-98f9-7c2db8f5f178 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 950 time: 0.0723712 Dec 08 11:43:51.826882 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2538f1ae-77e9-45a3-bfb2-010f4ed76e9d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:51.833058 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2538f1ae-77e9-45a3-bfb2-010f4ed76e9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:51.879105 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-70c23ba4-423d-4269-87b8-1f8c333292d3 req-9124b065-fde9-436f-819a-6776dda1faad tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/security-groups?id=5084168f-27e0-4418-8c4b-2da9ecf304d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0887740 Dec 08 11:43:51.884302 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2538f1ae-77e9-45a3-bfb2-010f4ed76e9d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f0f8ffef-941e-45c7-a4c5-8beca44ae8f1,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:51.889136 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-2538f1ae-77e9-45a3-bfb2-010f4ed76e9d admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=1a05484b867a4852b2635e4282e443ce&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2987163 Dec 08 11:43:51.891801 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 60788) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:51.937724 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0fd06d34-5524-4f8d-83cf-b9bbef11d9df admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:51.958558 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0fd06d34-5524-4f8d-83cf-b9bbef11d9df admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:52.006806 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0fd06d34-5524-4f8d-83cf-b9bbef11d9df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:52.009872 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-0fd06d34-5524-4f8d-83cf-b9bbef11d9df admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:52.011124 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-0fd06d34-5524-4f8d-83cf-b9bbef11d9df admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/f0f8ffef-941e-45c7-a4c5-8beca44ae8f1 HTTP/1.1" status: 204 len: 168 time: 0.1183920 Dec 08 11:43:52.019557 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd06d34-5524-4f8d-83cf-b9bbef11d9df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f0f8ffef-941e-45c7-a4c5-8beca44ae8f1,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:52.493101 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-5d074335-93c1-497d-b94d-238011d506c7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:52.601586 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 60810) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:52.695001 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1404242936-network', 'tenant_id': '8cd51b040b7242d084a290de749786b8'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:43:52.715319 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Made reservation on behalf of 8cd51b040b7242d084a290de749786b8 for: {'network': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:43:52.718161 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:52.726419 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:52.801655 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:52.805763 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:52.834969 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] vlan segment allocate from pool success with {'vlan_id': 258, 'physical_network': 'physnet1'} {{(pid=102318) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:43:52.839872 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ca139cba-47aa-43e1-9c5f-05a1fe2f205c,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:52.847997 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:52.848717 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.segments_db [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Added segment ff555cf3-b8bf-4823-b4fd-8d10dfe59870 of type vlan for network b6155a6c-7a89-4b5b-b3cb-d77c93560254 Dec 08 11:43:52.887144 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:52.914742 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:52.915901 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:52.916435 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:52.983509 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.3808181 Dec 08 11:43:52.986478 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 60816) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:52.991541 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-34ea11e3-9b18-49d7-940c-5614d3c4898b admin admin] Request body: {'subnet': {'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1404242936-subnet', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'ip_version': 4}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:43:53.004399 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d15f8ce2-dd53-4478-9213-49cfdb73b28f admin admin] Pushing event updated for resources: {'Network': ['ID=b6155a6c-7a89-4b5b-b3cb-d77c93560254,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:53.014249 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-34ea11e3-9b18-49d7-940c-5614d3c4898b admin admin] Made reservation on behalf of 8cd51b040b7242d084a290de749786b8 for: {'subnet': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:43:53.016634 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-34ea11e3-9b18-49d7-940c-5614d3c4898b admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5419653'] for subnet, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.018574 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network b6155a6c-7a89-4b5b-b3cb-d77c93560254 details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:43:53.026651 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ef90a4-15d4-42c6-8275-7426fa1efc82 req-9db12df3-6ee3-42c7-b473-a53e35a179f4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:53.028151 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c1ef90a4-15d4-42c6-8275-7426fa1efc82 req-9db12df3-6ee3-42c7-b473-a53e35a179f4 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 950 time: 0.0675793 Dec 08 11:43:53.076555 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c1ef90a4-15d4-42c6-8275-7426fa1efc82 req-9fb813d8-3778-4ca4-a16b-32139ce0c96f tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/security-groups?id=5084168f-27e0-4418-8c4b-2da9ecf304d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408535 Dec 08 11:43:53.194178 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-34ea11e3-9b18-49d7-940c-5614d3c4898b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5645724', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5419667'] for subnet, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.268235 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ea11e3-9b18-49d7-940c-5614d3c4898b admin admin] Pushing event updated for resources: {'Subnet': ['ID=4923b9ae-1dff-4272-9f7a-1921aac84705,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:53.277660 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34ea11e3-9b18-49d7-940c-5614d3c4898b admin admin] Checking segment: {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:43:53.278019 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34ea11e3-9b18-49d7-940c-5614d3c4898b admin admin] Network hostable DHCP agents. Network: b6155a6c-7a89-4b5b-b3cb-d77c93560254, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102317) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:43:53.294828 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34ea11e3-9b18-49d7-940c-5614d3c4898b admin admin] Network b6155a6c-7a89-4b5b-b3cb-d77c93560254 is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102317) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:43:53.303308 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-34ea11e3-9b18-49d7-940c-5614d3c4898b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, b6155a6c-7a89-4b5b-b3cb-d77c93560254) {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:43:53.308225 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-34ea11e3-9b18-49d7-940c-5614d3c4898b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:53.309039 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-34ea11e3-9b18-49d7-940c-5614d3c4898b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.312642 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68fb2446-e7d0-47d9-9610-eac258844a6b None None] Network b6155a6c-7a89-4b5b-b3cb-d77c93560254 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:43:53.330101 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-34ea11e3-9b18-49d7-940c-5614d3c4898b admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3423469 Dec 08 11:43:53.332810 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 60824) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:53.338334 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:43:53.346291 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee29de37-69f1-451d-8f05-db0330e17a7b req-1b154b8c-ab7c-42c0-85a4-33c346369087 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:53.347868 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ee29de37-69f1-451d-8f05-db0330e17a7b req-1b154b8c-ab7c-42c0-85a4-33c346369087 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 950 time: 0.0518913 Dec 08 11:43:53.359604 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7895423', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32171'] for router, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.360659 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7895279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7889720', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7925360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32176'] for router, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.403546 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ee29de37-69f1-451d-8f05-db0330e17a7b req-7950288c-60fd-4a63-9eda-38ab2d60315c tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/security-groups?id=5084168f-27e0-4418-8c4b-2da9ecf304d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485904 Dec 08 11:43:53.414453 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.422264 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp49d6adb3-88e2-5e36-b97e-28b28be9cdf8-b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705'}]}} from dv-cinder-819778-3-iscsi. {{(pid=102319) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 08 11:43:53.423275 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.549396 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.559626 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.db_base_plugin_common [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Allocated IP 172.20.0.2 (b6155a6c-7a89-4b5b-b3cb-d77c93560254/4923b9ae-1dff-4272-9f7a-1921aac84705/576d7257-e566-4e6a-8118-cd7311b9863e) {{(pid=102319) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:43:53.698514 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Publish callbacks [] for port, precommit_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.703270 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.743333 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Network b6155a6c-7a89-4b5b-b3cb-d77c93560254 is already hosted by enough agents. {{(pid=102319) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:43:53.746011 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.748690 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.base_scheduler [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Resources bound (agent type, host, resource id): {{(pid=102319) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:43:53.752127 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Received port after_create {{(pid=102319) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:43:53.758823 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Pushing event updated for resources: {'Port': ['ID=576d7257-e566-4e6a-8118-cd7311b9863e,revision_number=1']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:53.769773 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.807942 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Attempting to bind port 576d7257-e566-4e6a-8118-cd7311b9863e on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:43:53.808314 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Attempting to bind port 576d7257-e566-4e6a-8118-cd7311b9863e by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:43:53.808677 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Attempting to bind port 576d7257-e566-4e6a-8118-cd7311b9863e on network b6155a6c-7a89-4b5b-b3cb-d77c93560254 {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:43:53.814148 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 43, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:43:53.814521 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Checking segment: {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:43:53.814914 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.815304 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Bound using segment: {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:43:53.815768 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Bound port: 576d7257-e566-4e6a-8118-cd7311b9863e, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:43:53.816141 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.869291 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Allocated IP 172.27.2.122 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/c9282456-fdcc-4a90-83a3-fdaf335d07c3) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:43:53.877027 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] For port 576d7257-e566-4e6a-8118-cd7311b9863e, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:43:53.880644 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] For port 576d7257-e566-4e6a-8118-cd7311b9863e, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=576d7257-e566-4e6a-8118-cd7311b9863e,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:43:53.884876 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:53.944561 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1623174d-3784-40e4-a282-6c3676b48218 None None] Pushing event updated for resources: {'Port': ['ID=576d7257-e566-4e6a-8118-cd7311b9863e,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:53.975425 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:54.010006 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:54.049229 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:43:54.054360 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:43:54.060874 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:43:54.064008 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Pushing event updated for resources: {'Port': ['ID=c9282456-fdcc-4a90-83a3-fdaf335d07c3,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:54.328103 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:54.523619 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7895264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7889773'] for router, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:54.543023 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-491853c9-78bf-4305-8e2b-ae547409173f req-c3a79ccb-fe98-46c4-9dd2-7421fb246b0a tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:54.545318 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-491853c9-78bf-4305-8e2b-ae547409173f req-c3a79ccb-fe98-46c4-9dd2-7421fb246b0a tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 950 time: 0.0614259 Dec 08 11:43:54.596892 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-491853c9-78bf-4305-8e2b-ae547409173f req-d9013c7b-01fd-4153-ab59-d0fa0d434a23 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/security-groups?id=5084168f-27e0-4418-8c4b-2da9ecf304d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453367 Dec 08 11:43:54.663788 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Router 234433de-4188-442f-b5ef-12253c2924c3 is scheduled to L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f with binding_index 1 {{(pid=102317) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 08 11:43:54.695889 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 576d7257-e566-4e6a-8118-cd7311b9863e up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:43:54.750699 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1851213b-ba42-4b04-81de-0293a5367df8 req-236555d0-d2f8-407b-b43e-0c17e9cb2063 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:54.752506 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1851213b-ba42-4b04-81de-0293a5367df8 req-236555d0-d2f8-407b-b43e-0c17e9cb2063 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.61 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 950 time: 0.0680788 Dec 08 11:43:54.765138 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-22ed8f15-12de-4cf3-b45c-d18b3d6cde34 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:54.769072 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 576d7257-e566-4e6a-8118-cd7311b9863e triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:43:54.769649 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:54.861834 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-1851213b-ba42-4b04-81de-0293a5367df8 req-2b330911-165b-4b3c-bbd1-631b5182d261 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Deleting port 8e997973-70c0-4a18-88a4-6987a0a07c03 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:43:54.862175 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-1851213b-ba42-4b04-81de-0293a5367df8 req-2b330911-165b-4b3c-bbd1-631b5182d261 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:54.863018 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:54.878993 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c8c1fc5-aa9f-41d2-a320-2395bbe1b1cf None None] Network b6155a6c-7a89-4b5b-b3cb-d77c93560254 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:43:54.943034 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port 576d7257-e566-4e6a-8118-cd7311b9863e, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=576d7257-e566-4e6a-8118-cd7311b9863e,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:43:54.950034 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:54.964712 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-1851213b-ba42-4b04-81de-0293a5367df8 req-2b330911-165b-4b3c-bbd1-631b5182d261 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] For port 8e997973-70c0-4a18-88a4-6987a0a07c03, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=8e997973-70c0-4a18-88a4-6987a0a07c03,segment=NetworkSegment(e9f215c2-bfb7-4c9c-9387-63241407ac7e),segment_id=e9f215c2-bfb7-4c9c-9387-63241407ac7e)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:43:54.965075 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-1851213b-ba42-4b04-81de-0293a5367df8 req-2b330911-165b-4b3c-bbd1-631b5182d261 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:54.980059 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-1851213b-ba42-4b04-81de-0293a5367df8 req-2b330911-165b-4b3c-bbd1-631b5182d261 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Calling delete_port for 8e997973-70c0-4a18-88a4-6987a0a07c03 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:43:55.006176 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:43:55.025772 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] Publish callbacks [] for router, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:55.026993 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-f224c02c-4def-4683-8f90-ab89637ab13c admin admin] 10.222.0.66 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 1.6932054 Dec 08 11:43:55.030341 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 60828) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:55.038031 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Sync routers for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:43:55.056339 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-5b305890-451a-401c-aaa3-67e4010b41ae None None] Provisioning complete for port 576d7257-e566-4e6a-8118-cd7311b9863e triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:43:55.057192 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-5b305890-451a-401c-aaa3-67e4010b41ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:55.107189 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=576d7257-e566-4e6a-8118-cd7311b9863e,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:55.118830 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:43:55.119676 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:43:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:43:55.120527 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-1851213b-ba42-4b04-81de-0293a5367df8 req-2b330911-165b-4b3c-bbd1-631b5182d261 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:55.155752 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b330911-165b-4b3c-bbd1-631b5182d261 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Pushing event deleted for resources: {'Port': ['ID=8e997973-70c0-4a18-88a4-6987a0a07c03,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:55.210237 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-1851213b-ba42-4b04-81de-0293a5367df8 req-2b330911-165b-4b3c-bbd1-631b5182d261 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] No DVR routers for this DVR port 8e997973-70c0-4a18-88a4-6987a0a07c03 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:43:55.212902 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-1851213b-ba42-4b04-81de-0293a5367df8 req-2b330911-165b-4b3c-bbd1-631b5182d261 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:55.218770 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1851213b-ba42-4b04-81de-0293a5367df8 req-2b330911-165b-4b3c-bbd1-631b5182d261 tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.61 "DELETE /v2.0/ports/8e997973-70c0-4a18-88a4-6987a0a07c03 HTTP/1.1" status: 204 len: 173 time: 0.4597046 Dec 08 11:43:55.219256 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '93a3b4bc-2fd2-4906-b48d-8a83e07d267f', 'name': 'network-vif-deleted', 'tag': '8e997973-70c0-4a18-88a4-6987a0a07c03'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:43:55.221586 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd920b92-a546-42a9-a12c-3836a4790baf" -d '{"events": [{"server_uuid": "93a3b4bc-2fd2-4906-b48d-8a83e07d267f", "name": "network-vif-deleted", "tag": "8e997973-70c0-4a18-88a4-6987a0a07c03"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:43:55.319713 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:43:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2882ec24-a8fc-4aa2-b2e0-7f5e72e16532 x-openstack-request-id: req-2882ec24-a8fc-4aa2-b2e0-7f5e72e16532 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:43:55.320290 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "93a3b4bc-2fd2-4906-b48d-8a83e07d267f", "name": "network-vif-deleted", "tag": "8e997973-70c0-4a18-88a4-6987a0a07c03", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:43:55.320783 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-2882ec24-a8fc-4aa2-b2e0-7f5e72e16532 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:43:55.322082 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '93a3b4bc-2fd2-4906-b48d-8a83e07d267f', 'name': 'network-vif-deleted', 'tag': '8e997973-70c0-4a18-88a4-6987a0a07c03', 'status': 'completed', 'code': 200} Dec 08 11:43:55.337009 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:43:55.547225 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-b59e4bcd-636c-4002-a6fb-62428a95728c None None] Provisioning complete for port 576d7257-e566-4e6a-8118-cd7311b9863e triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:43:55.547592 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b59e4bcd-636c-4002-a6fb-62428a95728c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:55.549250 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:55.604017 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:54Z', 'revision_number': 3, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:53Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:43:55.632814 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Checking router: 234433de-4188-442f-b5ef-12253c2924c3 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:43:55.632814 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Updating router 234433de-4188-442f-b5ef-12253c2924c3 port c9282456-fdcc-4a90-83a3-fdaf335d07c3 binding host dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:43:55.688835 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:55.735620 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Allocated IP 172.20.0.1 (b6155a6c-7a89-4b5b-b3cb-d77c93560254/4923b9ae-1dff-4272-9f7a-1921aac84705/7ab3f4bf-1191-4491-9b0f-e248b2de3a62) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:43:55.737766 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5e3a1f0-4061-4e69-8a54-26e8a912529f req-ce12d0d1-fb90-4f41-b021-04eb5503ba8b tempest-VolumesNegativeTest-88559666 tempest-VolumesNegativeTest-88559666-project] 10.222.0.66 "GET /v2.0/ports?device_id=93a3b4bc-2fd2-4906-b48d-8a83e07d267f HTTP/1.1" status: 200 len: 210 time: 0.0312083 Dec 08 11:43:55.852686 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:55.869085 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:55.891534 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:55.930258 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Network b6155a6c-7a89-4b5b-b3cb-d77c93560254 is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:43:55.935030 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:43:55.938890 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:43:55.965023 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Pushing event updated for resources: {'Port': ['ID=7ab3f4bf-1191-4491-9b0f-e248b2de3a62,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:55.966458 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Publish callbacks [] for port, precommit_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:55.972083 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:55.991537 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7898680'] for router_interface, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:56.036374 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Attempting to bind port c9282456-fdcc-4a90-83a3-fdaf335d07c3 on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:43:56.036760 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Attempting to bind port c9282456-fdcc-4a90-83a3-fdaf335d07c3 by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:43:56.037105 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Attempting to bind port c9282456-fdcc-4a90-83a3-fdaf335d07c3 on network d7cb3021-649a-44ca-b3a1-005b3941164e {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:43:56.039179 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9d69af4-682d-41bf-9b20-f0cabedfd522 None None] Pushing event updated for resources: {'Port': ['ID=c9282456-fdcc-4a90-83a3-fdaf335d07c3,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:56.045771 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 43, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:43:56.046157 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Checking segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:43:56.046607 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:56.047008 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Bound using segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:43:56.047488 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Bound port: c9282456-fdcc-4a90-83a3-fdaf335d07c3, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:43:56.047871 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:56.103331 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] For port c9282456-fdcc-4a90-83a3-fdaf335d07c3, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:43:56.107896 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] For port c9282456-fdcc-4a90-83a3-fdaf335d07c3, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=c9282456-fdcc-4a90-83a3-fdaf335d07c3,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:43:56.111810 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:56.163846 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:56.170374 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:43:56.170984 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:43:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:43:56.175720 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9d69af4-682d-41bf-9b20-f0cabedfd522 None None] Pushing event updated for resources: {'Port': ['ID=c9282456-fdcc-4a90-83a3-fdaf335d07c3,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:56.239842 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-37798c9e-fe5b-4f7c-b232-d76c91182475 None None] Provisioning complete for port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:43:56.240131 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-37798c9e-fe5b-4f7c-b232-d76c91182475 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:56.332294 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:56.342753 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5648421'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:56.415762 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8074899', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7897000'] for router_interface, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:56.417722 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Pushing event updated for resources: {'Port': ['ID=7ab3f4bf-1191-4491-9b0f-e248b2de3a62,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:56.443077 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-37798c9e-fe5b-4f7c-b232-d76c91182475 None None] Port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:43:56.450589 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:43:56.510598 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Network b6155a6c-7a89-4b5b-b3cb-d77c93560254 is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:43:56.512013 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:43:56.633066 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Router 234433de-4188-442f-b5ef-12253c2924c3 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:43:56.667567 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:43:55Z', 'revision_number': 1, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:43:56.696139 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 576d7257-e566-4e6a-8118-cd7311b9863e up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:43:56.699335 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-077b0173-e7db-44f3-9129-28acf2f42c0a None None] The sync data for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi is: [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:43:55Z', 'revision_number': 1, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:43:56.750526 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 576d7257-e566-4e6a-8118-cd7311b9863e triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:43:56.750526 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:56.752363 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:43:56.765901 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-b08f42d7-2cce-42bb-9e86-189748ac38e5 admin admin] 10.222.0.66 "PUT /v2.0/routers/234433de-4188-442f-b5ef-12253c2924c3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7256501 Dec 08 11:43:56.801015 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-cb5f80b4-4630-45a2-9cbb-7325eb4b7bb3 None None] Provisioning complete for port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:43:56.801422 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-cb5f80b4-4630-45a2-9cbb-7325eb4b7bb3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:56.864219 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-cb5f80b4-4630-45a2-9cbb-7325eb4b7bb3 None None] Port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:43:57.094858 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 8e997973-70c0-4a18-88a4-6987a0a07c03 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:43:57.119190 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 8e997973-70c0-4a18-88a4-6987a0a07c03 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:43:57.119544 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 8e997973-70c0-4a18-88a4-6987a0a07c03 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:43:57.186755 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:57.328745 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 60870) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:57.333617 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-908931225-network', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:43:57.358663 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Made reservation on behalf of 4c5c7c9211184c1a9e4434afb8d87c87 for: {'network': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:43:57.361369 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for network, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:57.371052 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:57.475176 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:57.480037 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:57.510198 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] vlan segment allocate from pool success with {'vlan_id': 288, 'physical_network': 'physnet1'} {{(pid=102318) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 08 11:43:57.514562 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1328b6f2-0ee8-47b9-95dc-2a44753f2f34,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:57.529003 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:57.529577 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.segments_db [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Added segment 65cb28d1-d108-442c-9aee-e3538006a272 of type vlan for network 4b07857a-ba9d-41f1-8e5c-bf328cc970ca Dec 08 11:43:57.577366 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8729986435350'] for network, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:57.608424 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881'] for network, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:57.609504 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:57.610022 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:57.667127 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 60902) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:57.667702 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] 10.222.0.66 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.3373234 Dec 08 11:43:57.673367 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-c9dfc681-5b70-40ad-afd8-2e0a8f0d9df7 admin admin] Request body: {'subnet': {'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-908931225-subnet', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'ip_version': 4}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:43:57.688491 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03f38d97-7d1a-4c82-9493-8857f7505b37 admin admin] Pushing event updated for resources: {'Network': ['ID=4b07857a-ba9d-41f1-8e5c-bf328cc970ca,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:57.700206 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Network 4b07857a-ba9d-41f1-8e5c-bf328cc970ca details requested by agent ovs-agent-dv-cinder-819778-3-iscsi with host dv-cinder-819778-3-iscsi {{(pid=102319) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 08 11:43:57.705844 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c9dfc681-5b70-40ad-afd8-2e0a8f0d9df7 admin admin] Made reservation on behalf of 4c5c7c9211184c1a9e4434afb8d87c87 for: {'subnet': 1} {{(pid=102317) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:43:57.708595 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c9dfc681-5b70-40ad-afd8-2e0a8f0d9df7 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5419653'] for subnet, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:57.907311 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c9dfc681-5b70-40ad-afd8-2e0a8f0d9df7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5645724', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5419667'] for subnet, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:57.974668 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9dfc681-5b70-40ad-afd8-2e0a8f0d9df7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:57.979922 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9dfc681-5b70-40ad-afd8-2e0a8f0d9df7 admin admin] Checking segment: {'id': '65cb28d1-d108-442c-9aee-e3538006a272', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 288, 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102317) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:43:57.980300 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9dfc681-5b70-40ad-afd8-2e0a8f0d9df7 admin admin] Network hostable DHCP agents. Network: 4b07857a-ba9d-41f1-8e5c-bf328cc970ca, hostable agents: ['98ebe57f-4ff1-482f-8bbb-758a3ecb7211'], hosted agents: [] {{(pid=102317) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 08 11:43:58.000229 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9dfc681-5b70-40ad-afd8-2e0a8f0d9df7 admin admin] Network 4b07857a-ba9d-41f1-8e5c-bf328cc970ca is scheduled to be hosted by DHCP agent 98ebe57f-4ff1-482f-8bbb-758a3ecb7211 with binding_index 1 {{(pid=102317) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 08 11:43:58.011082 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-c9dfc681-5b70-40ad-afd8-2e0a8f0d9df7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819778-3-iscsi, 4b07857a-ba9d-41f1-8e5c-bf328cc970ca) {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:43:58.017555 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9dfc681-5b70-40ad-afd8-2e0a8f0d9df7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:43:58.018307 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c9dfc681-5b70-40ad-afd8-2e0a8f0d9df7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for subnet, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.021267 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69901899-88b1-4fa8-8e3d-455bfd64f180 None None] Network 4b07857a-ba9d-41f1-8e5c-bf328cc970ca requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:43:58.036427 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-c9dfc681-5b70-40ad-afd8-2e0a8f0d9df7 admin admin] 10.222.0.66 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3681164 Dec 08 11:43:58.039121 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 60944) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:43:58.046167 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-908931225-router', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:43:58.073362 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-7895423', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-32171'] for router, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.074578 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-7895279', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-7889720', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-7925360', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-32176'] for router, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.141552 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp49d6adb3-88e2-5e36-b97e-28b28be9cdf8-4b07857a-ba9d-41f1-8e5c-bf328cc970ca', 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca', 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'fixed_ips': [{'subnet_id': '7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8'}]}} from dv-cinder-819778-3-iscsi. {{(pid=102319) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 08 11:43:58.142542 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.150639 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.234086 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.317404 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.db_base_plugin_common [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Allocated IP 172.20.0.2 (4b07857a-ba9d-41f1-8e5c-bf328cc970ca/7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8/19c8d491-18d8-47e4-9db1-da9927e88510) {{(pid=102319) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:43:58.323539 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.500469 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Publish callbacks [] for port, precommit_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.513932 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728'] for port, after_create {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.542256 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.561110 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Network 4b07857a-ba9d-41f1-8e5c-bf328cc970ca is already hosted by enough agents. {{(pid=102319) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:43:58.562908 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.scheduler.base_scheduler [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Resources bound (agent type, host, resource id): {{(pid=102319) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:43:58.563900 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.564642 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Pushing event updated for resources: {'Port': ['ID=19c8d491-18d8-47e4-9db1-da9927e88510,revision_number=1']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:58.566951 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Received port after_create {{(pid=102319) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:43:58.636258 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Attempting to bind port 19c8d491-18d8-47e4-9db1-da9927e88510 on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:43:58.636640 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Attempting to bind port 19c8d491-18d8-47e4-9db1-da9927e88510 by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '65cb28d1-d108-442c-9aee-e3538006a272', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 288, 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:43:58.637005 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Attempting to bind port 19c8d491-18d8-47e4-9db1-da9927e88510 on network 4b07857a-ba9d-41f1-8e5c-bf328cc970ca {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:43:58.643886 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 43, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:43:58.644261 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Checking segment: {'id': '65cb28d1-d108-442c-9aee-e3538006a272', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 288, 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:43:58.644722 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.645064 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Bound using segment: {'id': '65cb28d1-d108-442c-9aee-e3538006a272', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 288, 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:43:58.645882 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Bound port: 19c8d491-18d8-47e4-9db1-da9927e88510, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '65cb28d1-d108-442c-9aee-e3538006a272', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 288, 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:43:58.646394 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.704662 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Allocated IP 172.27.2.112 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/21b6c408-2013-43fa-9eda-e37a66c387b9) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:43:58.743612 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device c9282456-fdcc-4a90-83a3-fdaf335d07c3 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:43:58.795228 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] For port 19c8d491-18d8-47e4-9db1-da9927e88510, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:43:58.810628 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] For port 19c8d491-18d8-47e4-9db1-da9927e88510, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=19c8d491-18d8-47e4-9db1-da9927e88510,segment=NetworkSegment(65cb28d1-d108-442c-9aee-e3538006a272),segment_id=65cb28d1-d108-442c-9aee-e3538006a272)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:43:58.818728 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.855111 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port c9282456-fdcc-4a90-83a3-fdaf335d07c3 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:43:58.855492 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.875467 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.930471 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.932348 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7193a54-c598-453c-92ed-ada28bb18778 None None] Pushing event updated for resources: {'Port': ['ID=19c8d491-18d8-47e4-9db1-da9927e88510,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:58.990509 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:58.996244 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:43:59.002313 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:43:59.006766 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:43:59.023527 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port c9282456-fdcc-4a90-83a3-fdaf335d07c3, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=c9282456-fdcc-4a90-83a3-fdaf335d07c3,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:43:59.032701 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Pushing event updated for resources: {'Port': ['ID=21b6c408-2013-43fa-9eda-e37a66c387b9,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:59.034961 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:59.147640 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=c9282456-fdcc-4a90-83a3-fdaf335d07c3,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:43:59.207839 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Sync routers for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:43:59.220496 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:43:59.221136 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:43:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:43:59.316486 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:59.337953 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:43:59.551611 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-7895264', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-7889773'] for router, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:59.562346 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 2, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:43:59.592430 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Checking router: 234433de-4188-442f-b5ef-12253c2924c3 for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:43:59.592777 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Updating router 234433de-4188-442f-b5ef-12253c2924c3 port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 binding host dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:43:59.619413 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:59.691712 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Router faaa5ca6-c2df-423e-aa75-314bee408a5b is scheduled to L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f with binding_index 1 {{(pid=102318) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 08 11:43:59.943387 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Publish callbacks [] for port, precommit_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:43:59.952560 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:00.077061 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Pushing event updated for resources: {'Port': ['ID=7ab3f4bf-1191-4491-9b0f-e248b2de3a62,revision_number=3']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:00.098180 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-715d7b90-4556-4df0-8ba6-906056c61d7b None None] Network 4b07857a-ba9d-41f1-8e5c-bf328cc970ca requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:44:00.103392 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:00.110863 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:00.113088 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:00.114292 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:00.115380 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:00.115948 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:00.116525 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:00.117604 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:00.117944 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:00.118292 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:00.118640 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:00.118975 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:00.119254 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102320) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:00.125336 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Attempting to bind port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:44:00.125931 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Attempting to bind port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:44:00.126480 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Attempting to bind port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 on network b6155a6c-7a89-4b5b-b3cb-d77c93560254 {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:44:00.133697 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 43, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:44:00.134065 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Checking segment: {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102320) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:44:00.134463 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:00.134850 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Bound using segment: {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:44:00.135316 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Bound port: 7ab3f4bf-1191-4491-9b0f-e248b2de3a62, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'}}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:44:00.135712 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:00.149899 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:44:00.184030 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] Publish callbacks [] for router, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:00.186267 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-cb15a0ea-26de-4213-8828-a6b6a4b83fa3 admin admin] 10.222.0.66 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.1453166 Dec 08 11:44:00.188968 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 32852) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:44:00.193537 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Sync routers for ids ['faaa5ca6-c2df-423e-aa75-314bee408a5b'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:44:00.232380 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Routers {'faaa5ca6-c2df-423e-aa75-314bee408a5b'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:44:00.233257 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:43:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['faaa5ca6-c2df-423e-aa75-314bee408a5b'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:00.233759 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] For port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102320) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:44:00.237708 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] For port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=7ab3f4bf-1191-4491-9b0f-e248b2de3a62,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102320) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:44:00.245712 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:00.335906 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-deacd488-bc0d-4f58-9634-52b719cb2f86 None None] Provisioning complete for port 19c8d491-18d8-47e4-9db1-da9927e88510 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:00.336245 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-deacd488-bc0d-4f58-9634-52b719cb2f86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:00.450900 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270d9980-72d5-4598-ac1a-89ab418c59ba None None] Pushing event updated for resources: {'Port': ['ID=7ab3f4bf-1191-4491-9b0f-e248b2de3a62,revision_number=4']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:00.459268 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:44:00.459750 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:43:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:00.479046 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Set router faaa5ca6-c2df-423e-aa75-314bee408a5b gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:44:00.645235 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-deacd488-bc0d-4f58-9634-52b719cb2f86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:00.667170 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:44:00.724057 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-deacd488-bc0d-4f58-9634-52b719cb2f86 None None] For port 19c8d491-18d8-47e4-9db1-da9927e88510, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=19c8d491-18d8-47e4-9db1-da9927e88510,segment=NetworkSegment(65cb28d1-d108-442c-9aee-e3538006a272),segment_id=65cb28d1-d108-442c-9aee-e3538006a272)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:44:00.735912 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-deacd488-bc0d-4f58-9634-52b719cb2f86 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:00.872724 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deacd488-bc0d-4f58-9634-52b719cb2f86 None None] Pushing event updated for resources: {'Port': ['ID=19c8d491-18d8-47e4-9db1-da9927e88510,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:00.894464 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:00.902517 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-639542f6-f687-477b-94f1-1b6501996642 None None] Provisioning complete for port 19c8d491-18d8-47e4-9db1-da9927e88510 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:00.902888 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-639542f6-f687-477b-94f1-1b6501996642 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:00.908078 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 19c8d491-18d8-47e4-9db1-da9927e88510 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:44:00.952822 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:00Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:00.979772 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6247078-09b4-4680-9c90-d5846b2e7ce8 None None] The sync data for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi is: [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:00Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:44:00.985544 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'name': 'tempest-TestVolumeBootPattern-908931225-router', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112'}], 'enable_snat': True}, 'gw_port_id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:43:59Z', 'revision_number': 3, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'gw_port': {'id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:13:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:01.018703 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Checking router: faaa5ca6-c2df-423e-aa75-314bee408a5b for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:44:01.019068 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Updating router faaa5ca6-c2df-423e-aa75-314bee408a5b port 21b6c408-2013-43fa-9eda-e37a66c387b9 binding host dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:44:01.059189 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Allocated IP 172.20.0.1 (4b07857a-ba9d-41f1-8e5c-bf328cc970ca/7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8/77409d9a-96ec-474c-b9a0-aecddc71a945) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:44:01.232826 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.237720 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 19c8d491-18d8-47e4-9db1-da9927e88510 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:01.237720 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.379737 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-639542f6-f687-477b-94f1-1b6501996642 None None] Provisioning complete for port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:01.380113 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-639542f6-f687-477b-94f1-1b6501996642 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.389835 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.425569 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.473723 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Network 4b07857a-ba9d-41f1-8e5c-bf328cc970ca is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:44:01.476835 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:44:01.483320 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:44:01.531019 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device c9282456-fdcc-4a90-83a3-fdaf335d07c3 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:44:01.534148 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-7898680'] for router_interface, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.536794 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Pushing event updated for resources: {'Port': ['ID=77409d9a-96ec-474c-b9a0-aecddc71a945,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:01.678994 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-639542f6-f687-477b-94f1-1b6501996642 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.685607 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port c9282456-fdcc-4a90-83a3-fdaf335d07c3 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:01.685607 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.711838 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.812272 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Publish callbacks [] for port, precommit_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.835057 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-639542f6-f687-477b-94f1-1b6501996642 None None] For port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=7ab3f4bf-1191-4491-9b0f-e248b2de3a62,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:44:01.838218 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.848062 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-639542f6-f687-477b-94f1-1b6501996642 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.873392 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 32872) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:44:01.913108 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:44:01.925246 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.933398 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5648421'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.942152 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Attempting to bind port 21b6c408-2013-43fa-9eda-e37a66c387b9 on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:44:01.942531 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Attempting to bind port 21b6c408-2013-43fa-9eda-e37a66c387b9 by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:44:01.942896 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Attempting to bind port 21b6c408-2013-43fa-9eda-e37a66c387b9 on network d7cb3021-649a-44ca-b3a1-005b3941164e {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:44:01.944742 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a177cf-93b0-466c-a6f0-6ccb179ca284 None None] Pushing event updated for resources: {'Port': ['ID=21b6c408-2013-43fa-9eda-e37a66c387b9,revision_number=2']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:01.984921 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 43, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:44:01.985351 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Checking segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102319) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:44:01.985754 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:01.986147 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Bound using segment: {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'} {{(pid=102319) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:44:01.986629 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.managers [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Bound port: 21b6c408-2013-43fa-9eda-e37a66c387b9, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'aced9233-ae52-4905-86c8-d88de08554cc', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e'}}] {{(pid=102319) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:44:01.987007 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:02.007960 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-8074899', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-7897000'] for router_interface, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:02.018156 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Pushing event updated for resources: {'Port': ['ID=77409d9a-96ec-474c-b9a0-aecddc71a945,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:02.042597 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-0d42de1d-c362-46b5-973d-080c911b7343 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=6aba8d1c389c4b30b9e9d118d99c8c26&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1674280 Dec 08 11:44:02.045911 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 32876) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:44:02.057870 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-639542f6-f687-477b-94f1-1b6501996642 None None] Pushing event updated for resources: {'Port': ['ID=7ab3f4bf-1191-4491-9b0f-e248b2de3a62,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:02.066993 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-44bd9daa-da02-4cde-accd-3a47b9f826bc None None] Provisioning complete for port 77409d9a-96ec-474c-b9a0-aecddc71a945 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:02.067569 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-44bd9daa-da02-4cde-accd-3a47b9f826bc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:02.102164 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6f07a4d2-022d-41c5-a732-26e563983cd9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:02.118585 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Network 4b07857a-ba9d-41f1-8e5c-bf328cc970ca is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:44:02.120169 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:44:02.127479 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6f07a4d2-022d-41c5-a732-26e563983cd9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:02.132724 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] For port 21b6c408-2013-43fa-9eda-e37a66c387b9, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102319) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:44:02.140530 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] For port 21b6c408-2013-43fa-9eda-e37a66c387b9, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=21b6c408-2013-43fa-9eda-e37a66c387b9,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:44:02.142137 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:02.142703 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:02.145267 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-44bd9daa-da02-4cde-accd-3a47b9f826bc None None] Port 77409d9a-96ec-474c-b9a0-aecddc71a945 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:44:02.166319 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:02.187300 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6f07a4d2-022d-41c5-a732-26e563983cd9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:02.190656 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6f07a4d2-022d-41c5-a732-26e563983cd9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:02.194984 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-6f07a4d2-022d-41c5-a732-26e563983cd9 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/5084168f-27e0-4418-8c4b-2da9ecf304d3 HTTP/1.1" status: 204 len: 168 time: 0.1478717 Dec 08 11:44:02.203350 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f07a4d2-022d-41c5-a732-26e563983cd9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5084168f-27e0-4418-8c4b-2da9ecf304d3,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:02.267218 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Router faaa5ca6-c2df-423e-aa75-314bee408a5b has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:44:02.290687 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Routers {'faaa5ca6-c2df-423e-aa75-314bee408a5b'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:44:02.291328 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:43:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['faaa5ca6-c2df-423e-aa75-314bee408a5b'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:02.293481 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54a177cf-93b0-466c-a6f0-6ccb179ca284 None None] Pushing event updated for resources: {'Port': ['ID=21b6c408-2013-43fa-9eda-e37a66c387b9,revision_number=3']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:02.413803 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:44:02.421855 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-0e7d426c-1282-47b4-9aaf-ef36205fb33d admin admin] 10.222.0.66 "PUT /v2.0/routers/faaa5ca6-c2df-423e-aa75-314bee408a5b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2309790 Dec 08 11:44:02.483118 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] Set router faaa5ca6-c2df-423e-aa75-314bee408a5b gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:44:02.516748 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-09e35e00-189d-4993-a57b-7c3f4b891333 None None] Provisioning complete for port 77409d9a-96ec-474c-b9a0-aecddc71a945 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:02.517247 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-09e35e00-189d-4993-a57b-7c3f4b891333 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:02.613936 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-09e35e00-189d-4993-a57b-7c3f4b891333 None None] Port 77409d9a-96ec-474c-b9a0-aecddc71a945 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:44:02.676413 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 19c8d491-18d8-47e4-9db1-da9927e88510 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:44:02.769958 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 19c8d491-18d8-47e4-9db1-da9927e88510 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:02.770339 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:02.811542 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'name': 'tempest-TestVolumeBootPattern-908931225-router', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112'}], 'enable_snat': True}, 'gw_port_id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 4, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'gw_port': {'id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:13:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:44:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '77409d9a-96ec-474c-b9a0-aecddc71a945', 'name': '', 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'mac_address': 'fa:16:3e:87:60:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': '7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:44:00Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 2, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'subnets': [{'id': '7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:02.838983 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1f18b133-4083-4a52-81e1-278dd94714ff None None] The sync data for ids ['faaa5ca6-c2df-423e-aa75-314bee408a5b'] in dv-cinder-819778-3-iscsi is: [{'id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'name': 'tempest-TestVolumeBootPattern-908931225-router', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112'}], 'enable_snat': True}, 'gw_port_id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 4, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'gw_port': {'id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:13:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:44:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '77409d9a-96ec-474c-b9a0-aecddc71a945', 'name': '', 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'mac_address': 'fa:16:3e:87:60:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': '7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:44:00Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 2, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'subnets': [{'id': '7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:44:02.883045 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:44:02.891026 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:44:02.905199 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 32886) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:44:02.909857 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-1d2258a7-36b0-4b32-8e48-ed8411536408 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1598406315', 'description': 'tempest-secgroup-smoke-1598406315 description', 'project_id': '8cd51b040b7242d084a290de749786b8'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:44:02.935557 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1d2258a7-36b0-4b32-8e48-ed8411536408 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:02.940289 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:02.940679 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.008076 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1d2258a7-36b0-4b32-8e48-ed8411536408 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.018073 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1d2258a7-36b0-4b32-8e48-ed8411536408 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.059259 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1d2258a7-36b0-4b32-8e48-ed8411536408 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.061015 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-1d2258a7-36b0-4b32-8e48-ed8411536408 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1547282 Dec 08 11:44:03.064231 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 32888) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:44:03.068831 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-ec034d5c-09a4-4811-86e6-f0f7aff11310 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Request body: {'security_group_rule': {'security_group_id': 'e47b7911-1842-43a5-a5fe-dedb91083734', 'project_id': '8cd51b040b7242d084a290de749786b8', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:44:03.074482 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d2258a7-36b0-4b32-8e48-ed8411536408 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e47b7911-1842-43a5-a5fe-dedb91083734,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:03.102270 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ec034d5c-09a4-4811-86e6-f0f7aff11310 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.161772 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ec034d5c-09a4-4811-86e6-f0f7aff11310 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.170649 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ec034d5c-09a4-4811-86e6-f0f7aff11310 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.193386 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec034d5c-09a4-4811-86e6-f0f7aff11310 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=31cbb164-7b40-4ccf-80e9-660a70734a12,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:03.197966 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-ec034d5c-09a4-4811-86e6-f0f7aff11310 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.202754 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 32890) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:44:03.202962 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-ec034d5c-09a4-4811-86e6-f0f7aff11310 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1375499 Dec 08 11:44:03.207429 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-8a9bfddf-2cd5-4eb1-a7d5-8efefa3cab8f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Request body: {'security_group_rule': {'security_group_id': 'e47b7911-1842-43a5-a5fe-dedb91083734', 'project_id': '8cd51b040b7242d084a290de749786b8', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:44:03.241622 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8a9bfddf-2cd5-4eb1-a7d5-8efefa3cab8f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.291184 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8a9bfddf-2cd5-4eb1-a7d5-8efefa3cab8f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.294893 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8a9bfddf-2cd5-4eb1-a7d5-8efefa3cab8f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.313462 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a9bfddf-2cd5-4eb1-a7d5-8efefa3cab8f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=43ebeadf-e716-4681-9bff-50b6741ca8e3,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:03.320712 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-8a9bfddf-2cd5-4eb1-a7d5-8efefa3cab8f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.321945 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-8a9bfddf-2cd5-4eb1-a7d5-8efefa3cab8f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1181431 Dec 08 11:44:03.324776 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 32892) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:44:03.332697 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-2610dd50-5011-4059-9157-03144de7303c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Request body: {'security_group_rule': {'security_group_id': 'e47b7911-1842-43a5-a5fe-dedb91083734', 'project_id': '8cd51b040b7242d084a290de749786b8', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:44:03.360274 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2610dd50-5011-4059-9157-03144de7303c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.421093 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2610dd50-5011-4059-9157-03144de7303c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.425347 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2610dd50-5011-4059-9157-03144de7303c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.443722 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2610dd50-5011-4059-9157-03144de7303c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5aca5e07-9fa1-4096-af2a-54f8c07cb0df,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:03.453420 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2610dd50-5011-4059-9157-03144de7303c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.454720 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-2610dd50-5011-4059-9157-03144de7303c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1267512 Dec 08 11:44:03.457412 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 32894) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:44:03.461666 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-1e0f6819-658d-46b8-8e9b-cbad0b830f58 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Request body: {'security_group_rule': {'security_group_id': 'e47b7911-1842-43a5-a5fe-dedb91083734', 'project_id': '8cd51b040b7242d084a290de749786b8', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:44:03.487733 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1e0f6819-658d-46b8-8e9b-cbad0b830f58 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.543082 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1e0f6819-658d-46b8-8e9b-cbad0b830f58 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.546429 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1e0f6819-658d-46b8-8e9b-cbad0b830f58 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.563148 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e0f6819-658d-46b8-8e9b-cbad0b830f58 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=15df8630-a8b7-4f3b-a0e0-64b670780dbc,revision_number=0']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:03.570780 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1e0f6819-658d-46b8-8e9b-cbad0b830f58 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.571938 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-1e0f6819-658d-46b8-8e9b-cbad0b830f58 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1136045 Dec 08 11:44:03.574995 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 32896) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:44:03.580114 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-c60a6f5d-0952-409f-b420-1212da05b620 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Request body: {'security_group_rule': {'security_group_id': 'e47b7911-1842-43a5-a5fe-dedb91083734', 'project_id': '8cd51b040b7242d084a290de749786b8', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:44:03.605559 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.securitygroups_db [None req-c60a6f5d-0952-409f-b420-1212da05b620 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Project 8cd51b040b7242d084a290de749786b8 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 08 11:44:03.621056 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c60a6f5d-0952-409f-b420-1212da05b620 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.694354 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c60a6f5d-0952-409f-b420-1212da05b620 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.698365 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c60a6f5d-0952-409f-b420-1212da05b620 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.718445 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c60a6f5d-0952-409f-b420-1212da05b620 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7085d82a-6ccd-4ffd-80a7-06987ef8cd34,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:03.726297 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-c60a6f5d-0952-409f-b420-1212da05b620 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.727940 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-c60a6f5d-0952-409f-b420-1212da05b620 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1510973 Dec 08 11:44:03.730480 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 32898) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:44:03.735503 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-40654076-df36-4e8e-943e-4dc7285bb1d4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Request body: {'security_group_rule': {'security_group_id': 'e47b7911-1842-43a5-a5fe-dedb91083734', 'project_id': '8cd51b040b7242d084a290de749786b8', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:44:03.758229 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.securitygroups_db [None req-40654076-df36-4e8e-943e-4dc7285bb1d4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Project 8cd51b040b7242d084a290de749786b8 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 08 11:44:03.764505 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-40654076-df36-4e8e-943e-4dc7285bb1d4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.825303 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-40654076-df36-4e8e-943e-4dc7285bb1d4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.830519 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-40654076-df36-4e8e-943e-4dc7285bb1d4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-108737'] for security_group_rule, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.849087 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40654076-df36-4e8e-943e-4dc7285bb1d4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b939d9c7-58bf-4e3d-8d0f-1f7c8ce82241,revision_number=0']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:03.856675 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-40654076-df36-4e8e-943e-4dc7285bb1d4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:03.857989 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-40654076-df36-4e8e-943e-4dc7285bb1d4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1264501 Dec 08 11:44:04.696152 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 21b6c408-2013-43fa-9eda-e37a66c387b9 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:44:04.745402 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 21b6c408-2013-43fa-9eda-e37a66c387b9 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:04.746043 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:04.927018 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Sync routers for ids ['faaa5ca6-c2df-423e-aa75-314bee408a5b'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:44:04.940118 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Routers {'faaa5ca6-c2df-423e-aa75-314bee408a5b'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:44:04.940721 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:43:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['faaa5ca6-c2df-423e-aa75-314bee408a5b'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:04.962290 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:04.982779 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] For port 21b6c408-2013-43fa-9eda-e37a66c387b9, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=21b6c408-2013-43fa-9eda-e37a66c387b9,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:44:04.987391 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:05.042324 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Pushing event updated for resources: {'Port': ['ID=21b6c408-2013-43fa-9eda-e37a66c387b9,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:05.060284 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Set router faaa5ca6-c2df-423e-aa75-314bee408a5b gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:44:05.259023 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'name': 'tempest-TestVolumeBootPattern-908931225-router', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112'}], 'enable_snat': True}, 'gw_port_id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 4, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'gw_port': {'id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:13:17', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:44:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '77409d9a-96ec-474c-b9a0-aecddc71a945', 'name': '', 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'mac_address': 'fa:16:3e:87:60:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': '7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:44:00Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 2, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'subnets': [{'id': '7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:05.284337 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Checking router: faaa5ca6-c2df-423e-aa75-314bee408a5b for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:44:05.284678 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Updating router faaa5ca6-c2df-423e-aa75-314bee408a5b port 77409d9a-96ec-474c-b9a0-aecddc71a945 binding host dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 08 11:44:05.311901 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:05.580157 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Publish callbacks [] for port, precommit_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:05.585372 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:05.665109 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a35de9b-02bc-434a-85b4-bd398cd10a31 None None] Pushing event updated for resources: {'Port': ['ID=77409d9a-96ec-474c-b9a0-aecddc71a945,revision_number=3']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:05.703103 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Attempting to bind port 77409d9a-96ec-474c-b9a0-aecddc71a945 on host dv-cinder-819778-3-iscsi for vnic_type normal with profile {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:44:05.703474 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Attempting to bind port 77409d9a-96ec-474c-b9a0-aecddc71a945 by drivers openvswitch,hyperv on host dv-cinder-819778-3-iscsi at level 0 using segments [{'id': '65cb28d1-d108-442c-9aee-e3538006a272', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 288, 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca'}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:44:05.703830 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Attempting to bind port 77409d9a-96ec-474c-b9a0-aecddc71a945 on network 4b07857a-ba9d-41f1-8e5c-bf328cc970ca {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:44:05.709331 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Checking agent: {'id': '9c54d35e-ff32-4ebf-86e5-20cfc155f0c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819778-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 23, 28), 'started_at': datetime.datetime(2021, 12, 8, 11, 23, 58), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 43, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819778-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:44:05.709698 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Checking segment: {'id': '65cb28d1-d108-442c-9aee-e3538006a272', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 288, 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102320) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:44:05.710089 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:05.710473 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Bound using segment: {'id': '65cb28d1-d108-442c-9aee-e3538006a272', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 288, 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca'} {{(pid=102320) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:44:05.710932 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.managers [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Bound port: 77409d9a-96ec-474c-b9a0-aecddc71a945, host: dv-cinder-819778-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '65cb28d1-d108-442c-9aee-e3538006a272', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 288, 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca'}}] {{(pid=102320) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:44:05.711319 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:05.774019 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] For port 77409d9a-96ec-474c-b9a0-aecddc71a945, host dv-cinder-819778-3-iscsi, cleared binding levels {{(pid=102320) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:44:05.777041 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.plugins.ml2.db [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] For port 77409d9a-96ec-474c-b9a0-aecddc71a945, host dv-cinder-819778-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=77409d9a-96ec-474c-b9a0-aecddc71a945,segment=NetworkSegment(65cb28d1-d108-442c-9aee-e3538006a272),segment_id=65cb28d1-d108-442c-9aee-e3538006a272)] {{(pid=102320) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:44:05.782107 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron_lib.callbacks.manager [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102320) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:05.833219 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Routers {'faaa5ca6-c2df-423e-aa75-314bee408a5b'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:44:05.833845 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:43:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['faaa5ca6-c2df-423e-aa75-314bee408a5b'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:05.863954 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-2e62a1c9-029c-4f16-b3ae-7cc36204b4b0 None None] Provisioning complete for port 77409d9a-96ec-474c-b9a0-aecddc71a945 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:05.865027 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2e62a1c9-029c-4f16-b3ae-7cc36204b4b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:05.885066 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a35de9b-02bc-434a-85b4-bd398cd10a31 None None] Pushing event updated for resources: {'Port': ['ID=77409d9a-96ec-474c-b9a0-aecddc71a945,revision_number=4']} {{(pid=102320) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:05.965760 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2e62a1c9-029c-4f16-b3ae-7cc36204b4b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:05.967202 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] Set router faaa5ca6-c2df-423e-aa75-314bee408a5b gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:44:06.005041 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-2e62a1c9-029c-4f16-b3ae-7cc36204b4b0 None None] For port 77409d9a-96ec-474c-b9a0-aecddc71a945, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=77409d9a-96ec-474c-b9a0-aecddc71a945,segment=NetworkSegment(65cb28d1-d108-442c-9aee-e3538006a272),segment_id=65cb28d1-d108-442c-9aee-e3538006a272)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:44:06.009637 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2e62a1c9-029c-4f16-b3ae-7cc36204b4b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:06.057407 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e62a1c9-029c-4f16-b3ae-7cc36204b4b0 None None] Pushing event updated for resources: {'Port': ['ID=77409d9a-96ec-474c-b9a0-aecddc71a945,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:06.129518 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-0c6e8e85-59e8-4883-9b52-4b347108e687 None None] Provisioning complete for port 77409d9a-96ec-474c-b9a0-aecddc71a945 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:06.129885 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0c6e8e85-59e8-4883-9b52-4b347108e687 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:06.166966 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'name': 'tempest-TestVolumeBootPattern-908931225-router', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112'}], 'enable_snat': True}, 'gw_port_id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 4, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'gw_port': {'id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:13:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:44:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '77409d9a-96ec-474c-b9a0-aecddc71a945', 'name': '', 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'mac_address': 'fa:16:3e:87:60:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': '7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:44:00Z', 'updated_at': '2021-12-08T11:44:05Z', 'revision_number': 4, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'subnets': [{'id': '7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:06.280539 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c9abb581-2205-469f-ae51-b6779fd0b689 None None] The sync data for ids ['faaa5ca6-c2df-423e-aa75-314bee408a5b'] in dv-cinder-819778-3-iscsi is: [{'id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'name': 'tempest-TestVolumeBootPattern-908931225-router', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112'}], 'enable_snat': True}, 'gw_port_id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 4, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'gw_port': {'id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:13:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:44:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '77409d9a-96ec-474c-b9a0-aecddc71a945', 'name': '', 'network_id': '4b07857a-ba9d-41f1-8e5c-bf328cc970ca', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'mac_address': 'fa:16:3e:87:60:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_interface', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': '7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:44:00Z', 'updated_at': '2021-12-08T11:44:05Z', 'revision_number': 4, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'subnets': [{'id': '7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:44:06.694264 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 21b6c408-2013-43fa-9eda-e37a66c387b9 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:44:06.743354 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 21b6c408-2013-43fa-9eda-e37a66c387b9 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:06.743734 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:06.826445 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 77409d9a-96ec-474c-b9a0-aecddc71a945 up at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:44:06.871126 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Provisioning complete for port 77409d9a-96ec-474c-b9a0-aecddc71a945 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:06.871736 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:17.731974 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:22.494640 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-616626f9-982b-421e-bf85-0210ba5436da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:24.719153 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-5cb9eb6e-3f15-4f41-a8da-3cb73ed5af45 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:25.827781 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:27.173292 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:27.497068 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-e387a49f-d7e8-43aa-863d-3178604f2cbb tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1598406315&fields=id&tenant_id=8cd51b040b7242d084a290de749786b8 HTTP/1.1" status: 200 len: 267 time: 0.0440886 Dec 08 11:44:27.598521 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-4a48611b-79c5-46b4-bf26-412dfc6aeaef tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:27.599942 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-4a48611b-79c5-46b4-bf26-412dfc6aeaef tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 812 time: 0.0962749 Dec 08 11:44:27.614041 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-fb987f53-2620-4eac-a53c-4cb548ad1951 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/quotas/8cd51b040b7242d084a290de749786b8 HTTP/1.1" status: 200 len: 375 time: 0.0085912 Dec 08 11:44:27.665864 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-2a6cde90-b019-4577-a4d3-742c818a11da tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0467224 Dec 08 11:44:27.769217 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-fc8cc3cc-3a1f-42c4-9bb8-820c1917827d service neutron] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102318) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:44:27.770196 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-fc8cc3cc-3a1f-42c4-9bb8-820c1917827d service neutron] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0910826 Dec 08 11:44:27.854201 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-161f29b0-0566-4f44-8b7b-a7162a1e2235 service neutron] 10.222.0.66 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0778549 Dec 08 11:44:27.942557 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-14b4590d-d969-4c5d-8aee-b2b1be61ea48 service neutron] 10.222.0.66 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823183 Dec 08 11:44:28.178081 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:28.230571 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c1ba4885-dbd6-484f-9652-de4b52371984 req-26148a1f-1cc5-454e-a40c-d6f2b90a8c8c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 210 time: 0.0282800 Dec 08 11:44:29.182649 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-bb7ac34d-a679-4f8d-aad4-7d3e0370444b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:29.184118 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-bb7ac34d-a679-4f8d-aad4-7d3e0370444b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 812 time: 0.1073544 Dec 08 11:44:29.255462 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-1945f7c9-1142-4129-8934-966b70fdfdeb tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8cd51b040b7242d084a290de749786b8 HTTP/1.1" status: 200 len: 380 time: 0.0591197 Dec 08 11:44:29.266635 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Request body: {'port': {'device_id': '8bc862ae-0de5-4018-9e1c-6e8898557c37', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'admin_state_up': True, 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'security_groups': ['e47b7911-1842-43a5-a5fe-dedb91083734']}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:44:29.335444 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e27b9191-7a07-4457-abda-9066d6b67abc req-eecfc6f8-06f6-42d4-8640-e2b321dbfe3a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 210 time: 0.0301151 Dec 08 11:44:29.393886 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Made reservation on behalf of 8cd51b040b7242d084a290de749786b8 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:44:29.397349 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:29.522015 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Allocated IP 172.20.0.8 (b6155a6c-7a89-4b5b-b3cb-d77c93560254/4923b9ae-1dff-4272-9f7a-1921aac84705/68177bf4-695b-4333-8e9c-95704a3235a4) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:44:29.665512 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:29.699119 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:29.740107 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Network b6155a6c-7a89-4b5b-b3cb-d77c93560254 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:44:29.744918 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:44:29.748561 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:44:29.771604 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'Port': ['ID=68177bf4-695b-4333-8e9c-95704a3235a4,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:29.784741 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:29.785090 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:29.785457 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:29.785788 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:29.786114 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:29.786436 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:29.786765 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:29.787084 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:29.787401 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:29.787723 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:29.788038 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:29.788352 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:29.788666 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:44:29.810539 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:29.811150 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:29.828274 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-ff73e2ff-6fc9-408c-9b51-1baddd567e43 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5663218 Dec 08 11:44:29.923903 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Request body: {'port': {'device_id': '8bc862ae-0de5-4018-9e1c-6e8898557c37', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:44:29.973804 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-6239f1da-2b4f-4e64-aac1-04c07a809426 None None] Provisioning complete for port 68177bf4-695b-4333-8e9c-95704a3235a4 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:29.974397 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-6239f1da-2b4f-4e64-aac1-04c07a809426 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:29.979517 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:30.007135 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-6239f1da-2b4f-4e64-aac1-04c07a809426 None None] Port 68177bf4-695b-4333-8e9c-95704a3235a4 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:44:30.232462 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 68177bf4-695b-4333-8e9c-95704a3235a4 {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:44:30.242389 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:30.254139 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Transition to ACTIVE for port object 68177bf4-695b-4333-8e9c-95704a3235a4 will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:44:30.258175 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:30.307909 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Pushing event updated for resources: {'Port': ['ID=68177bf4-695b-4333-8e9c-95704a3235a4,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:30.380179 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Attempting to bind port 68177bf4-695b-4333-8e9c-95704a3235a4 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:44:30.380510 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Attempting to bind port 68177bf4-695b-4333-8e9c-95704a3235a4 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:44:30.380839 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Attempting to bind port 68177bf4-695b-4333-8e9c-95704a3235a4 on network b6155a6c-7a89-4b5b-b3cb-d77c93560254 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:44:30.385448 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Port 68177bf4-695b-4333-8e9c-95704a3235a4 on network b6155a6c-7a89-4b5b-b3cb-d77c93560254 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:44:30.385773 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Attempting to bind port 68177bf4-695b-4333-8e9c-95704a3235a4 on network b6155a6c-7a89-4b5b-b3cb-d77c93560254 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:44:30.391380 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 44, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:44:30.391712 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Checking segment: {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:44:30.392088 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Bound using segment: {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:44:30.392521 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Bound port: 68177bf4-695b-4333-8e9c-95704a3235a4, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:44:30.392863 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:30.493751 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0bdd94e-8316-419c-bea6-f52877b3f8f4 req-59963e03-befe-42b8-93af-af93d2cc3115 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:30.495151 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f0bdd94e-8316-419c-bea6-f52877b3f8f4 req-59963e03-befe-42b8-93af-af93d2cc3115 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 943 time: 0.0890768 Dec 08 11:44:30.497500 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] For port 68177bf4-695b-4333-8e9c-95704a3235a4, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:44:30.501460 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] For port 68177bf4-695b-4333-8e9c-95704a3235a4, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=68177bf4-695b-4333-8e9c-95704a3235a4,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:44:30.511287 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:30.555604 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:30.556224 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:30.557630 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] 10.222.0.61 "PUT /v2.0/ports/68177bf4-695b-4333-8e9c-95704a3235a4 HTTP/1.1" status: 200 len: 1093 time: 0.6380808 Dec 08 11:44:30.559649 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8bc862ae-0de5-4018-9e1c-6e8898557c37', 'tag': '68177bf4-695b-4333-8e9c-95704a3235a4'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:44:30.562281 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8fd5e23c-d275-4761-aaef-b9bb390983b7" -d '{"events": [{"name": "network-changed", "server_uuid": "8bc862ae-0de5-4018-9e1c-6e8898557c37", "tag": "68177bf4-695b-4333-8e9c-95704a3235a4"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:44:30.612187 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f0bdd94e-8316-419c-bea6-f52877b3f8f4 req-e781a99d-33a5-4c8a-891a-77f946eaaa6f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1086986 Dec 08 11:44:30.613716 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:44:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c070543c-c007-425d-b8be-994258d62a55 x-openstack-request-id: req-c070543c-c007-425d-b8be-994258d62a55 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:44:30.614011 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8bc862ae-0de5-4018-9e1c-6e8898557c37", "tag": "68177bf4-695b-4333-8e9c-95704a3235a4", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:44:30.614269 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-c070543c-c007-425d-b8be-994258d62a55 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:44:30.614716 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8bc862ae-0de5-4018-9e1c-6e8898557c37', 'tag': '68177bf4-695b-4333-8e9c-95704a3235a4', 'status': 'completed', 'code': 200} Dec 08 11:44:30.615401 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-645cacca-cf10-470c-a551-bbf793966c08 service neutron] Pushing event updated for resources: {'Port': ['ID=68177bf4-695b-4333-8e9c-95704a3235a4,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:30.660164 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-4ef7c0d7-a9b1-49c1-8ff6-44e9f2f59fb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:30.661712 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-4ef7c0d7-a9b1-49c1-8ff6-44e9f2f59fb1 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 1096 time: 0.0431976 Dec 08 11:44:30.705494 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-863d0b91-4195-42bd-95e5-04651f44a84e service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=68177bf4-695b-4333-8e9c-95704a3235a4 HTTP/1.1" status: 200 len: 217 time: 0.0352066 Dec 08 11:44:30.756966 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-9b1df060-116e-437b-b30a-6cf85be7082d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:30.758438 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-9b1df060-116e-437b-b30a-6cf85be7082d service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0469332 Dec 08 11:44:30.802978 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-7eaee488-d35b-4c49-a85c-9f6caec01888 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:30.804419 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-7eaee488-d35b-4c49-a85c-9f6caec01888 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0383866 Dec 08 11:44:30.892281 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-37ec7068-0940-46f8-b11e-e86fa01b1ae0 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0803370 Dec 08 11:44:30.982052 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6b0acfe4-29f3-44f6-b43e-963bcbd4367b req-504dfd57-d8d7-438d-8d32-7e786fa482a4 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828328 Dec 08 11:44:31.070975 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-2eac9f91-8d4a-4417-bdb4-ea9b62ebe7a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:31.072369 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-2eac9f91-8d4a-4417-bdb4-ea9b62ebe7a7 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 1096 time: 0.0407732 Dec 08 11:44:31.164036 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-01f19050-fbb4-4226-8687-8202239473bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:31.165546 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-01f19050-fbb4-4226-8687-8202239473bd service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.0853376 Dec 08 11:44:31.207442 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-1407b0b5-0a9d-4385-9108-67cecc45ac64 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=68177bf4-695b-4333-8e9c-95704a3235a4 HTTP/1.1" status: 200 len: 217 time: 0.0336130 Dec 08 11:44:31.256426 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-f4283c6f-812b-49ad-bfdb-aa66b96a9f63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:31.257877 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-f4283c6f-812b-49ad-bfdb-aa66b96a9f63 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0438392 Dec 08 11:44:31.305510 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-4d0743b8-f280-4211-8bf8-ca7bbfbcb689 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:31.306949 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-4d0743b8-f280-4211-8bf8-ca7bbfbcb689 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0423160 Dec 08 11:44:31.393799 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-942aabe6-25ed-4566-812e-ea0c1a22b0e1 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0783341 Dec 08 11:44:31.485080 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8fd5e23c-d275-4761-aaef-b9bb390983b7 req-95c31553-14c1-430c-bb8f-2b90428f7ac7 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0847337 Dec 08 11:44:31.747187 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-791323ee-96cd-4f0c-a85f-fa78de917607 req-d34746b7-b974-42d8-b16c-8722b5d0eeff tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:31.748634 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-791323ee-96cd-4f0c-a85f-fa78de917607 req-d34746b7-b974-42d8-b16c-8722b5d0eeff tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 943 time: 0.0486035 Dec 08 11:44:31.796938 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-791323ee-96cd-4f0c-a85f-fa78de917607 req-7d3779b1-23c6-4e34-9512-42fbfe697725 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424187 Dec 08 11:44:32.909606 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb9f7b62-0b18-4eb5-885e-f22054a46d82 req-6834cf8c-c68b-47a6-a808-1ae4f158f1f0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:32.910976 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bb9f7b62-0b18-4eb5-885e-f22054a46d82 req-6834cf8c-c68b-47a6-a808-1ae4f158f1f0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 943 time: 0.0477219 Dec 08 11:44:32.958516 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bb9f7b62-0b18-4eb5-885e-f22054a46d82 req-9bac8cd0-9e63-4982-a393-81879e72a054 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418227 Dec 08 11:44:34.073175 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38e1e1f6-9d57-48de-8452-d6d272344251 req-5e692c6b-1db3-49b6-a7cf-6d652519048e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:34.074605 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-38e1e1f6-9d57-48de-8452-d6d272344251 req-5e692c6b-1db3-49b6-a7cf-6d652519048e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 943 time: 0.0513184 Dec 08 11:44:34.123185 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-38e1e1f6-9d57-48de-8452-d6d272344251 req-44e2c984-25b7-4e33-b2d1-f4072d7f93e9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421009 Dec 08 11:44:35.235487 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dc5b5e7-be7f-4f1c-90b3-843fa7a071be req-4bd72a9b-dd69-499d-9eaa-5a4bba2d8356 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:35.236984 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8dc5b5e7-be7f-4f1c-90b3-843fa7a071be req-4bd72a9b-dd69-499d-9eaa-5a4bba2d8356 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 943 time: 0.0492361 Dec 08 11:44:35.285205 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8dc5b5e7-be7f-4f1c-90b3-843fa7a071be req-e862f2db-a5c6-4bd0-a9af-c774e1860b5e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423353 Dec 08 11:44:36.396582 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf03b0e1-e70f-48fb-84cc-a50f127fb81e req-3d6bf1af-497f-4868-a6d8-6cadca8ec51a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:36.398007 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf03b0e1-e70f-48fb-84cc-a50f127fb81e req-3d6bf1af-497f-4868-a6d8-6cadca8ec51a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 943 time: 0.0483723 Dec 08 11:44:36.450188 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf03b0e1-e70f-48fb-84cc-a50f127fb81e req-67ca5685-6d87-4ce3-9ae6-b999531156ce tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463142 Dec 08 11:44:37.568292 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd80d5fc-65f8-4ddb-b17b-4edc1b81b543 req-1b8cbaac-1edf-45d4-81bf-83c1cd523972 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:37.569771 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd80d5fc-65f8-4ddb-b17b-4edc1b81b543 req-1b8cbaac-1edf-45d4-81bf-83c1cd523972 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 943 time: 0.0471971 Dec 08 11:44:37.617421 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dd80d5fc-65f8-4ddb-b17b-4edc1b81b543 req-b2898aa7-b213-4111-91f3-f4d216d5c5f7 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411725 Dec 08 11:44:38.728614 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6029b2f-98b1-4c73-b575-3dfb48b9b3b5 req-ead2515a-8767-496b-a827-9be81d59c65b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:38.730087 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f6029b2f-98b1-4c73-b575-3dfb48b9b3b5 req-ead2515a-8767-496b-a827-9be81d59c65b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 943 time: 0.0477602 Dec 08 11:44:38.778984 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f6029b2f-98b1-4c73-b575-3dfb48b9b3b5 req-88f13ccc-5011-46d4-9b87-421178856ebc tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426776 Dec 08 11:44:39.300726 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 68177bf4-695b-4333-8e9c-95704a3235a4 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:44:39.391366 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 68177bf4-695b-4333-8e9c-95704a3235a4, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=68177bf4-695b-4333-8e9c-95704a3235a4,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:44:39.402322 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '68177bf4-695b-4333-8e9c-95704a3235a4', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'port_id': '68177bf4-695b-4333-8e9c-95704a3235a4', 'mac_address': 'fa:16:3e:4a:23:b9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 258, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:44:39.441683 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:39.453686 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 68177bf4-695b-4333-8e9c-95704a3235a4 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:44:39.471795 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 68177bf4-695b-4333-8e9c-95704a3235a4, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=68177bf4-695b-4333-8e9c-95704a3235a4,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:44:39.475639 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:39.521900 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=68177bf4-695b-4333-8e9c-95704a3235a4,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:39.784517 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['68177bf4-695b-4333-8e9c-95704a3235a4'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:44:39.891423 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:44:39.894930 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c776a00-687d-4564-a1b8-2b5c2300fe36 req-11b572d0-23dc-4e81-a79a-4ae94a06b37f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:39.896420 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4c776a00-687d-4564-a1b8-2b5c2300fe36 req-11b572d0-23dc-4e81-a79a-4ae94a06b37f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 944 time: 0.0523348 Dec 08 11:44:39.944392 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4c776a00-687d-4564-a1b8-2b5c2300fe36 req-1a003b9a-2e80-4113-bf7e-afe5ba802a0d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418735 Dec 08 11:44:41.058291 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3bffaf-8ff0-42e8-becf-fcfe9a4ab8b6 req-af09736a-cc4f-4b50-b269-ed90f985a07b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:41.059737 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3e3bffaf-8ff0-42e8-becf-fcfe9a4ab8b6 req-af09736a-cc4f-4b50-b269-ed90f985a07b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 944 time: 0.0481291 Dec 08 11:44:41.108275 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3e3bffaf-8ff0-42e8-becf-fcfe9a4ab8b6 req-ee43ac9a-5758-4476-a9ba-00089ffea1cf tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427516 Dec 08 11:44:41.319937 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 68177bf4-695b-4333-8e9c-95704a3235a4 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:44:41.368177 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 68177bf4-695b-4333-8e9c-95704a3235a4 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:44:41.371993 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 68177bf4-695b-4333-8e9c-95704a3235a4 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:44:41.372357 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:41.450247 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:41.471388 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8bc862ae-0de5-4018-9e1c-6e8898557c37', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '68177bf4-695b-4333-8e9c-95704a3235a4'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:44:41.473821 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cea66637-4617-4964-98df-87bad7142fde" -d '{"events": [{"server_uuid": "8bc862ae-0de5-4018-9e1c-6e8898557c37", "name": "network-vif-plugged", "status": "completed", "tag": "68177bf4-695b-4333-8e9c-95704a3235a4"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:44:41.487041 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 68177bf4-695b-4333-8e9c-95704a3235a4, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=68177bf4-695b-4333-8e9c-95704a3235a4,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:44:41.490931 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:41.538551 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=68177bf4-695b-4333-8e9c-95704a3235a4,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:41.574626 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:44:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-67122d52-8f90-4f2c-b851-2be2d0e5fb0c x-openstack-request-id: req-67122d52-8f90-4f2c-b851-2be2d0e5fb0c {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:44:41.574920 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8bc862ae-0de5-4018-9e1c-6e8898557c37", "name": "network-vif-plugged", "status": "completed", "tag": "68177bf4-695b-4333-8e9c-95704a3235a4", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:44:41.575174 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-67122d52-8f90-4f2c-b851-2be2d0e5fb0c {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:44:41.575592 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8bc862ae-0de5-4018-9e1c-6e8898557c37', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '68177bf4-695b-4333-8e9c-95704a3235a4', 'code': 200} Dec 08 11:44:41.787631 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced06539-9653-48f0-aed5-6c8ea25c44d7 req-296a85a0-adcc-4ec4-8ce8-3ae0f8d71894 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:41.789060 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ced06539-9653-48f0-aed5-6c8ea25c44d7 req-296a85a0-adcc-4ec4-8ce8-3ae0f8d71894 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 1098 time: 0.0426445 Dec 08 11:44:41.833292 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ced06539-9653-48f0-aed5-6c8ea25c44d7 req-e335a3d1-fcef-462e-82c5-c3eb70ea0dc6 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0366387 Dec 08 11:44:42.219612 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c93fecc-c1e0-46cb-af8f-c446209650ed req-074f52c4-417c-43e6-8f58-0b395856afea tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:42.221079 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8c93fecc-c1e0-46cb-af8f-c446209650ed req-074f52c4-417c-43e6-8f58-0b395856afea tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 945 time: 0.0472713 Dec 08 11:44:42.269841 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8c93fecc-c1e0-46cb-af8f-c446209650ed req-0d018aa2-27fa-48f5-9de2-db77421406d3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427845 Dec 08 11:44:43.382553 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca556b5-2a20-45a8-9c12-edadad4f9aeb req-06695e82-07ec-4828-af9e-5b105df77644 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:43.383911 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8ca556b5-2a20-45a8-9c12-edadad4f9aeb req-06695e82-07ec-4828-af9e-5b105df77644 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 945 time: 0.0467923 Dec 08 11:44:43.435148 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8ca556b5-2a20-45a8-9c12-edadad4f9aeb req-d732328f-17fd-45f5-9e7d-be48a5ed27b4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443807 Dec 08 11:44:43.544469 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d655e244-f0e1-4886-a996-c1af45a9f7b8 req-78b58fdb-dc33-40cb-969b-732ecd93a6a4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:43.545927 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d655e244-f0e1-4886-a996-c1af45a9f7b8 req-78b58fdb-dc33-40cb-969b-732ecd93a6a4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 945 time: 0.0470796 Dec 08 11:44:43.593952 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d655e244-f0e1-4886-a996-c1af45a9f7b8 req-00bd3c54-a3db-4f83-93d1-c2cbe0666560 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422256 Dec 08 11:44:43.615166 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33076) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:44:43.711217 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db55d62c-7284-4bf7-9761-cfbae667d54b tempest-TestVolumeBootPattern-1413654375 tempest-TestVolumeBootPattern-1413654375-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:43.712690 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-db55d62c-7284-4bf7-9761-cfbae667d54b tempest-TestVolumeBootPattern-1413654375 tempest-TestVolumeBootPattern-1413654375-project-admin] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 1093 time: 0.0965621 Dec 08 11:44:43.715487 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33080) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:44:43.719641 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Request body: {'floatingip': {'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'port_id': '68177bf4-695b-4333-8e9c-95704a3235a4', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address': '172.20.0.8'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:44:43.741401 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for floatingip, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:43.837251 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:43.936275 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Allocated IP 172.27.2.86 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/66086c64-e361-427a-a641-83b7c2b6acab) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:44:44.035837 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:44.068659 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:44.104014 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:44:44.107366 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:44:44.113204 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:44:44.135404 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'Port': ['ID=66086c64-e361-427a-a641-83b7c2b6acab,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:44.459892 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:44.523149 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:44.669992 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:44.674304 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:44.742410 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'Port': ['ID=66086c64-e361-427a-a641-83b7c2b6acab,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:44:44.754908 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:44.852406 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Floating IP 0b33a32f-8f06-476d-999e-294727587a32 associated. External IP: 172.27.2.86, port: 68177bf4-695b-4333-8e9c-95704a3235a4. Dec 08 11:44:45.049692 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Router 234433de-4188-442f-b5ef-12253c2924c3 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:44:45.423618 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:44:45.432988 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70ce0b8c-d18f-4a8d-accb-ed6f0223a621 None None] Sync routers for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:44:45.441009 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:45.444170 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70ce0b8c-d18f-4a8d-accb-ed6f0223a621 None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:44:45.444784 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-70ce0b8c-d18f-4a8d-accb-ed6f0223a621 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:44:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:45.469958 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-3794e0b1-b5bd-4b40-a820-76f3a43f024b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.7534714 Dec 08 11:44:45.470601 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8bc862ae-0de5-4018-9e1c-6e8898557c37', 'tag': '68177bf4-695b-4333-8e9c-95704a3235a4'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:44:45.472795 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e" -d '{"events": [{"name": "network-changed", "server_uuid": "8bc862ae-0de5-4018-9e1c-6e8898557c37", "tag": "68177bf4-695b-4333-8e9c-95704a3235a4"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:44:45.509236 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:44:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b091b37f-b184-4f3f-bc44-f1a7b8fb52d3 x-openstack-request-id: req-b091b37f-b184-4f3f-bc44-f1a7b8fb52d3 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:44:45.509533 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8bc862ae-0de5-4018-9e1c-6e8898557c37", "tag": "68177bf4-695b-4333-8e9c-95704a3235a4", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:44:45.509788 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-b091b37f-b184-4f3f-bc44-f1a7b8fb52d3 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:44:45.510188 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8bc862ae-0de5-4018-9e1c-6e8898557c37', 'tag': '68177bf4-695b-4333-8e9c-95704a3235a4', 'status': 'completed', 'code': 200} Dec 08 11:44:45.554192 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-70ce0b8c-d18f-4a8d-accb-ed6f0223a621 None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:44:45.572122 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-59b95b41-3bfb-4f24-b34f-aed3264b1930 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:45.573643 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-59b95b41-3bfb-4f24-b34f-aed3264b1930 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 1098 time: 0.0401869 Dec 08 11:44:45.662352 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-a3f27d01-0648-4c39-a6ac-99698dd14b13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:45.663821 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-a3f27d01-0648-4c39-a6ac-99698dd14b13 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.0833249 Dec 08 11:44:45.732550 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-fbf2a077-516c-486f-840b-e25a37cf706c service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=68177bf4-695b-4333-8e9c-95704a3235a4 HTTP/1.1" status: 200 len: 998 time: 0.0615776 Dec 08 11:44:45.778502 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-70ce0b8c-d18f-4a8d-accb-ed6f0223a621 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': '0b33a32f-8f06-476d-999e-294727587a32', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.86', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': '68177bf4-695b-4333-8e9c-95704a3235a4', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 696, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:4a:23:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8bc862ae-0de5-4018-9e1c-6e8898557c37', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:44:44Z', 'updated_at': '2021-12-08T11:44:44Z', 'revision_number': 0, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:45.781069 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-3a6f043b-24a0-4d73-ad9f-a60b5a15ffdb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:45.782558 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-3a6f043b-24a0-4d73-ad9f-a60b5a15ffdb service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0436213 Dec 08 11:44:45.804966 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70ce0b8c-d18f-4a8d-accb-ed6f0223a621 None None] Checking router: 234433de-4188-442f-b5ef-12253c2924c3 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:44:45.813289 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70ce0b8c-d18f-4a8d-accb-ed6f0223a621 None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:44:45.813886 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-70ce0b8c-d18f-4a8d-accb-ed6f0223a621 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:44:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:45.829500 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-4d749bfe-56b6-4f48-8562-83993058e9a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:44:45.831002 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-4d749bfe-56b6-4f48-8562-83993058e9a4 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0411811 Dec 08 11:44:45.918391 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-70ce0b8c-d18f-4a8d-accb-ed6f0223a621 None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:44:45.928359 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-959716e5-ecd7-4806-9df6-036a67524896 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0897183 Dec 08 11:44:46.017181 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3f5e094c-a6c7-4c4f-a9df-bbbbddfcfc7e req-8b42a969-70a1-4a6f-b1f3-abc31051ed40 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813715 Dec 08 11:44:46.138948 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-70ce0b8c-d18f-4a8d-accb-ed6f0223a621 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': '0b33a32f-8f06-476d-999e-294727587a32', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.86', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': '68177bf4-695b-4333-8e9c-95704a3235a4', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 696, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:4a:23:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8bc862ae-0de5-4018-9e1c-6e8898557c37', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:44:44Z', 'updated_at': '2021-12-08T11:44:44Z', 'revision_number': 0, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:44:46.164423 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70ce0b8c-d18f-4a8d-accb-ed6f0223a621 None None] The sync data for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi is: [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': '0b33a32f-8f06-476d-999e-294727587a32', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.86', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': '68177bf4-695b-4333-8e9c-95704a3235a4', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 696, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:4a:23:b9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8bc862ae-0de5-4018-9e1c-6e8898557c37', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:44:44Z', 'updated_at': '2021-12-08T11:44:44Z', 'revision_number': 0, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:44:46.359150 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2156a8c3-d817-4701-8745-2d2f32156de8 None None] New status for floating IP 0b33a32f-8f06-476d-999e-294727587a32: ACTIVE {{(pid=102320) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:44:47.737062 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:52.495292 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2b5989d3-9ea1-442c-85ab-7354b4b452da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:54.720809 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-264627c7-af66-494b-b100-9c0d74055bd1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:55.826859 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:57.174637 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:44:58.179920 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:45:16.891174 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:45:17.725704 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:45:22.496728 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-23dbf7cf-2d74-44bc-b807-e3d25fde551c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:45:23.652536 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-13bce867-43fa-4b84-a1de-f2caa37adb02 req-8ac90e52-fca4-4e0c-a189-ca1e9043f3ce service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0395665 Dec 08 11:45:23.738236 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bce867-43fa-4b84-a1de-f2caa37adb02 req-5743bdf7-ae4d-42fe-84ee-08791313fd0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:45:23.739695 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-13bce867-43fa-4b84-a1de-f2caa37adb02 req-5743bdf7-ae4d-42fe-84ee-08791313fd0a service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 1098 time: 0.0448532 Dec 08 11:45:23.839923 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bce867-43fa-4b84-a1de-f2caa37adb02 req-a40a0e6d-69ba-40bc-a35b-d4b233d2235f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:45:23.841428 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-13bce867-43fa-4b84-a1de-f2caa37adb02 req-a40a0e6d-69ba-40bc-a35b-d4b233d2235f service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.0822752 Dec 08 11:45:23.910112 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-13bce867-43fa-4b84-a1de-f2caa37adb02 req-0f33444f-4b0a-40ac-93d1-ef5d1047cdba service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=68177bf4-695b-4333-8e9c-95704a3235a4 HTTP/1.1" status: 200 len: 1000 time: 0.0604808 Dec 08 11:45:23.959466 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bce867-43fa-4b84-a1de-f2caa37adb02 req-43d165fe-81d8-4cd6-a7d7-f93b52367877 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:45:23.960853 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-13bce867-43fa-4b84-a1de-f2caa37adb02 req-43d165fe-81d8-4cd6-a7d7-f93b52367877 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0424891 Dec 08 11:45:24.006178 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13bce867-43fa-4b84-a1de-f2caa37adb02 req-6c027248-531d-41a1-843f-e3913cae9291 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:45:24.007619 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-13bce867-43fa-4b84-a1de-f2caa37adb02 req-6c027248-531d-41a1-843f-e3913cae9291 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0383596 Dec 08 11:45:24.099155 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-13bce867-43fa-4b84-a1de-f2caa37adb02 req-dca13e21-e427-4f77-8090-32ff157ee843 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823023 Dec 08 11:45:24.187678 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-13bce867-43fa-4b84-a1de-f2caa37adb02 req-5bb6e958-d57e-4a7e-b234-612b98b37eb3 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0799980 Dec 08 11:45:24.724668 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b1dae08e-729e-482c-93b8-79baca725b96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:45:25.829043 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:45:27.179209 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:45:28.181402 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:45:47.734217 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:45:52.499081 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-c3d38916-5e2a-490a-9d65-fa6f295643a2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:45:53.890743 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:45:54.726274 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-e3621d54-4201-49f0-b0d8-66726733b5ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:45:55.832117 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:45:57.184509 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:45:58.182826 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:46:17.720563 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:46:22.500610 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fa0f7148-2be7-4b65-96aa-540ec248d786 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:46:23.642479 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf6a7598-78b5-4959-bf84-5256da2ee9ad req-e31c5685-1d6e-4c06-a6cb-fab320ef8c84 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0399859 Dec 08 11:46:23.728489 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf6a7598-78b5-4959-bf84-5256da2ee9ad req-b8e8534e-9c1b-43a0-8ca0-0f994db1da1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:46:23.730165 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf6a7598-78b5-4959-bf84-5256da2ee9ad req-b8e8534e-9c1b-43a0-8ca0-0f994db1da1d service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 1098 time: 0.0443857 Dec 08 11:46:23.830384 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf6a7598-78b5-4959-bf84-5256da2ee9ad req-b0bb12cc-72d1-4fa5-9e63-65c1156c6cf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:46:23.831809 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf6a7598-78b5-4959-bf84-5256da2ee9ad req-b0bb12cc-72d1-4fa5-9e63-65c1156c6cf8 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.0815563 Dec 08 11:46:23.901294 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf6a7598-78b5-4959-bf84-5256da2ee9ad req-f74da50d-b2bd-4271-b41b-426796120f60 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=68177bf4-695b-4333-8e9c-95704a3235a4 HTTP/1.1" status: 200 len: 1000 time: 0.0617537 Dec 08 11:46:23.949105 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf6a7598-78b5-4959-bf84-5256da2ee9ad req-f6fdfc25-8408-4022-b0af-0d7afde39603 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:46:23.950517 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf6a7598-78b5-4959-bf84-5256da2ee9ad req-f6fdfc25-8408-4022-b0af-0d7afde39603 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0418966 Dec 08 11:46:23.995714 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf6a7598-78b5-4959-bf84-5256da2ee9ad req-474072bf-d49a-4d94-892b-66af033184de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:46:23.997758 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf6a7598-78b5-4959-bf84-5256da2ee9ad req-474072bf-d49a-4d94-892b-66af033184de service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0391943 Dec 08 11:46:24.087441 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf6a7598-78b5-4959-bf84-5256da2ee9ad req-c82aa596-29f9-4062-847c-3b805f9c491d service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825779 Dec 08 11:46:24.175452 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-cf6a7598-78b5-4959-bf84-5256da2ee9ad req-66cb2f8a-0295-4b83-9e86-8054ddf69bd5 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0795126 Dec 08 11:46:24.726673 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-5af6e495-11a6-46fe-a5e9-5191c816ecb5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:46:25.834608 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:46:27.184821 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:46:28.185822 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:46:30.889062 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:46:47.720718 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:46:52.501832 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d9c579d3-5a4d-456e-ade2-f78a911a3b2a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:46:54.727351 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1a3432a0-404f-4d03-8035-3e0bc9675d84 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:46:55.837796 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:46:57.187001 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:46:58.187919 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:46:59.799997 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-480e1c0b-a8cc-4942-b998-bc995471c2b3 req-91c0a3fb-c558-4eb4-bdc8-8ad4b39b5f8e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:46:59.801373 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-480e1c0b-a8cc-4942-b998-bc995471c2b3 req-91c0a3fb-c558-4eb4-bdc8-8ad4b39b5f8e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 945 time: 0.1233637 Dec 08 11:46:59.852778 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-480e1c0b-a8cc-4942-b998-bc995471c2b3 req-a3eb8be6-667d-4c58-997f-e50ce298080b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454605 Dec 08 11:47:01.029325 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206b3b0d-e423-47cc-b65e-811eb17acd4f req-6fbfabe0-75e5-443b-ba79-5b2195579c11 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:01.030775 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-206b3b0d-e423-47cc-b65e-811eb17acd4f req-6fbfabe0-75e5-443b-ba79-5b2195579c11 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 945 time: 0.0981777 Dec 08 11:47:01.080344 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-206b3b0d-e423-47cc-b65e-811eb17acd4f req-1a69b8ba-2df7-4332-85c0-5c4fe3642bbf tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428565 Dec 08 11:47:01.351288 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-4ec08abf-2ddb-41d5-81bb-2f1b2c56f741 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:01.352707 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-4ec08abf-2ddb-41d5-81bb-2f1b2c56f741 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 945 time: 0.0462301 Dec 08 11:47:01.444940 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Deleting port 68177bf4-695b-4333-8e9c-95704a3235a4 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:47:01.445303 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:01.529735 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] For port 68177bf4-695b-4333-8e9c-95704a3235a4, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=68177bf4-695b-4333-8e9c-95704a3235a4,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:47:01.530096 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:01.697138 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:01.700600 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:01.700600 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Floating IP 0b33a32f-8f06-476d-999e-294727587a32 disassociated. External IP: 172.27.2.86, port: 68177bf4-695b-4333-8e9c-95704a3235a4. Dec 08 11:47:01.700600 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling delete_port for 68177bf4-695b-4333-8e9c-95704a3235a4 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:47:01.820049 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:01.855246 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event deleted for resources: {'Port': ['ID=68177bf4-695b-4333-8e9c-95704a3235a4,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:47:01.866179 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:01.866533 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:01.866882 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:01.867251 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:01.867588 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:01.867920 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:01.868252 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:01.872115 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:01.872115 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:01.872115 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:01.872115 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:01.872115 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:01.872115 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:01.972014 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Router 234433de-4188-442f-b5ef-12253c2924c3 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:47:02.074418 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:47:02.084928 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-656ef45f-db56-4a32-af11-a0b3b5630f06 None None] Sync routers for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:47:02.095386 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-656ef45f-db56-4a32-af11-a0b3b5630f06 None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:47:02.096068 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-656ef45f-db56-4a32-af11-a0b3b5630f06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:46:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:47:02.119658 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] No DVR routers for this DVR port 68177bf4-695b-4333-8e9c-95704a3235a4 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:47:02.123863 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:02.128510 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-4c6a84af-27cb-4e1f-9747-dd2621710eb6 req-24f1fe3f-726c-44b8-a8b1-c03ef6ac0884 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "DELETE /v2.0/ports/68177bf4-695b-4333-8e9c-95704a3235a4 HTTP/1.1" status: 204 len: 173 time: 0.7682636 Dec 08 11:47:02.128651 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8bc862ae-0de5-4018-9e1c-6e8898557c37', 'name': 'network-vif-deleted', 'tag': '68177bf4-695b-4333-8e9c-95704a3235a4'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:47:02.132479 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-31599f96-a0a5-4847-8540-f3b24e9c71eb" -d '{"events": [{"server_uuid": "8bc862ae-0de5-4018-9e1c-6e8898557c37", "name": "network-vif-deleted", "tag": "68177bf4-695b-4333-8e9c-95704a3235a4"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:47:02.210403 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-656ef45f-db56-4a32-af11-a0b3b5630f06 None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:47:02.212760 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-95a6dad8-6f03-413c-a04b-dac8ad97b525 req-a2482b83-969a-4240-a62a-36f711a482ab tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=8bc862ae-0de5-4018-9e1c-6e8898557c37 HTTP/1.1" status: 200 len: 210 time: 0.0418611 Dec 08 11:47:02.260650 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:47:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-85e32145-d219-4bfb-8f18-fcbac5533935 x-openstack-request-id: req-85e32145-d219-4bfb-8f18-fcbac5533935 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:47:02.260815 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8bc862ae-0de5-4018-9e1c-6e8898557c37", "name": "network-vif-deleted", "tag": "68177bf4-695b-4333-8e9c-95704a3235a4", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:47:02.261127 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-85e32145-d219-4bfb-8f18-fcbac5533935 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:47:02.261692 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8bc862ae-0de5-4018-9e1c-6e8898557c37', 'name': 'network-vif-deleted', 'tag': '68177bf4-695b-4333-8e9c-95704a3235a4', 'status': 'completed', 'code': 200} Dec 08 11:47:02.422150 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-656ef45f-db56-4a32-af11-a0b3b5630f06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:47:02.448760 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-656ef45f-db56-4a32-af11-a0b3b5630f06 None None] Checking router: 234433de-4188-442f-b5ef-12253c2924c3 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:47:02.457055 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-656ef45f-db56-4a32-af11-a0b3b5630f06 None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:47:02.457686 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-656ef45f-db56-4a32-af11-a0b3b5630f06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:46:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:47:02.564030 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-656ef45f-db56-4a32-af11-a0b3b5630f06 None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:47:02.755942 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-656ef45f-db56-4a32-af11-a0b3b5630f06 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:47:02.784176 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-656ef45f-db56-4a32-af11-a0b3b5630f06 None None] The sync data for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi is: [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:47:03.001358 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13715cd2-ceb1-4d96-95d4-1a545d1b1972 None None] New status for floating IP 0b33a32f-8f06-476d-999e-294727587a32: DOWN {{(pid=102320) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:47:03.418068 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-436046e5-0ae3-462b-a6db-3186346fb389 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1598406315&fields=id&tenant_id=8cd51b040b7242d084a290de749786b8 HTTP/1.1" status: 200 len: 267 time: 0.0430088 Dec 08 11:47:03.522853 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-91a6a5e4-fd7c-49e3-9210-c4cbb5d695c0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:03.524272 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-91a6a5e4-fd7c-49e3-9210-c4cbb5d695c0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 812 time: 0.0996923 Dec 08 11:47:03.538604 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-9f5e8673-5b64-480d-a72f-1c021a3a816a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/quotas/8cd51b040b7242d084a290de749786b8 HTTP/1.1" status: 200 len: 375 time: 0.0085559 Dec 08 11:47:03.586901 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fffe92f5-ac4a-406a-91dc-780b130e5e80 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0432713 Dec 08 11:47:03.676201 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-2bbd1220-4cba-495d-9d25-dda3c8f31a50 service neutron] 10.222.0.66 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0777342 Dec 08 11:47:03.772931 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-20e5511f-4324-409b-b590-d52cdcc6c8eb service neutron] 10.222.0.66 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0905344 Dec 08 11:47:04.042312 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-88568eaa-de3b-427b-9e79-f7d94979cc3e req-8b8d278d-5a74-4940-85d3-5ceca5417023 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 210 time: 0.0258703 Dec 08 11:47:04.948080 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-43286a77-0862-4dee-ab0a-02d254767c86 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:04.949558 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-43286a77-0862-4dee-ab0a-02d254767c86 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 812 time: 0.1085060 Dec 08 11:47:05.013319 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-28154739-3139-47a6-af41-8bf6318a3fcf tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8cd51b040b7242d084a290de749786b8 HTTP/1.1" status: 200 len: 380 time: 0.0532477 Dec 08 11:47:05.022409 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb6d2a81-4a9f-4a8f-b718-18b20934ceb0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Request body: {'port': {'device_id': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'admin_state_up': True, 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'security_groups': ['e47b7911-1842-43a5-a5fe-dedb91083734']}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:47:05.142172 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c8215b3e-928c-410d-ba90-889571ac9768 req-896fd8c2-55ec-4530-b2a6-fe9281b56f57 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 210 time: 0.0273664 Dec 08 11:47:05.162901 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb6d2a81-4a9f-4a8f-b718-18b20934ceb0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Made reservation on behalf of 8cd51b040b7242d084a290de749786b8 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:47:05.166407 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb6d2a81-4a9f-4a8f-b718-18b20934ceb0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:05.290298 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb6d2a81-4a9f-4a8f-b718-18b20934ceb0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Allocated IP 172.20.0.5 (b6155a6c-7a89-4b5b-b3cb-d77c93560254/4923b9ae-1dff-4272-9f7a-1921aac84705/5c746524-978d-4ccf-9310-1c436d0934a6) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:47:05.432595 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb6d2a81-4a9f-4a8f-b718-18b20934ceb0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:05.464427 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb6d2a81-4a9f-4a8f-b718-18b20934ceb0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:05.508261 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb6d2a81-4a9f-4a8f-b718-18b20934ceb0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Network b6155a6c-7a89-4b5b-b3cb-d77c93560254 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:47:05.513328 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb6d2a81-4a9f-4a8f-b718-18b20934ceb0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:47:05.517424 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb6d2a81-4a9f-4a8f-b718-18b20934ceb0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:47:05.540764 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb6d2a81-4a9f-4a8f-b718-18b20934ceb0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'Port': ['ID=5c746524-978d-4ccf-9310-1c436d0934a6,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:47:05.569502 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb6d2a81-4a9f-4a8f-b718-18b20934ceb0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:05.570117 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb6d2a81-4a9f-4a8f-b718-18b20934ceb0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:05.587457 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb6d2a81-4a9f-4a8f-b718-18b20934ceb0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5685661 Dec 08 11:47:05.600334 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Request body: {'port': {'device_id': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:47:05.655047 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:05.774674 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-19378452-1ff9-4fd7-9cbe-b46b062affbc None None] Provisioning complete for port 5c746524-978d-4ccf-9310-1c436d0934a6 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:47:05.775240 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-19378452-1ff9-4fd7-9cbe-b46b062affbc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:05.807182 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-19378452-1ff9-4fd7-9cbe-b46b062affbc None None] Port 5c746524-978d-4ccf-9310-1c436d0934a6 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:47:05.916711 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5c746524-978d-4ccf-9310-1c436d0934a6 {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:47:05.923962 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:05.935809 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Transition to ACTIVE for port object 5c746524-978d-4ccf-9310-1c436d0934a6 will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:47:05.939566 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:05.973773 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 68177bf4-695b-4333-8e9c-95704a3235a4 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:47:05.988837 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Pushing event updated for resources: {'Port': ['ID=5c746524-978d-4ccf-9310-1c436d0934a6,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:47:05.999844 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 68177bf4-695b-4333-8e9c-95704a3235a4 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:47:05.999954 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 68177bf4-695b-4333-8e9c-95704a3235a4 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:47:06.057911 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Attempting to bind port 5c746524-978d-4ccf-9310-1c436d0934a6 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:47:06.058249 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Attempting to bind port 5c746524-978d-4ccf-9310-1c436d0934a6 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:47:06.058578 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Attempting to bind port 5c746524-978d-4ccf-9310-1c436d0934a6 on network b6155a6c-7a89-4b5b-b3cb-d77c93560254 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:47:06.063813 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Port 5c746524-978d-4ccf-9310-1c436d0934a6 on network b6155a6c-7a89-4b5b-b3cb-d77c93560254 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:47:06.064170 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Attempting to bind port 5c746524-978d-4ccf-9310-1c436d0934a6 on network b6155a6c-7a89-4b5b-b3cb-d77c93560254 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:47:06.074133 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 46, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:47:06.074460 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Checking segment: {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:47:06.074847 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Bound using segment: {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:47:06.075281 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Bound port: 5c746524-978d-4ccf-9310-1c436d0934a6, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:47:06.075640 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:06.148192 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] For port 5c746524-978d-4ccf-9310-1c436d0934a6, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:47:06.151171 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] For port 5c746524-978d-4ccf-9310-1c436d0934a6, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=5c746524-978d-4ccf-9310-1c436d0934a6,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:47:06.156054 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:06.190659 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:06.191348 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:06.192759 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] 10.222.0.61 "PUT /v2.0/ports/5c746524-978d-4ccf-9310-1c436d0934a6 HTTP/1.1" status: 200 len: 1093 time: 0.5966716 Dec 08 11:47:06.193231 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'tag': '5c746524-978d-4ccf-9310-1c436d0934a6'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:47:06.195524 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-53908a1c-096f-4134-98ae-2974b9cc56b3" -d '{"events": [{"name": "network-changed", "server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:47:06.247597 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5df3a285-c47b-4e00-9af3-54767488f5b1 service neutron] Pushing event updated for resources: {'Port': ['ID=5c746524-978d-4ccf-9310-1c436d0934a6,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:47:06.266945 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:47:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f6884b3a-6344-4dd1-8acf-062f7847dce0 x-openstack-request-id: req-f6884b3a-6344-4dd1-8acf-062f7847dce0 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:47:06.267246 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:47:06.267507 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-f6884b3a-6344-4dd1-8acf-062f7847dce0 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:47:06.267910 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'tag': '5c746524-978d-4ccf-9310-1c436d0934a6', 'status': 'completed', 'code': 200} Dec 08 11:47:06.297219 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cf44dfd-8768-4b92-a22e-ac9327e3f4d3 req-e507145b-e19d-40dd-a5b4-41ebc74e6b54 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:06.298723 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3cf44dfd-8768-4b92-a22e-ac9327e3f4d3 req-e507145b-e19d-40dd-a5b4-41ebc74e6b54 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 943 time: 0.0843706 Dec 08 11:47:06.325127 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-a25fd721-b2e0-4b29-83ad-34b4fdb89451 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:06.326679 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-a25fd721-b2e0-4b29-83ad-34b4fdb89451 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 1096 time: 0.0719087 Dec 08 11:47:06.384668 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-248d2756-6f01-46c8-9e2b-e48f46d03626 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5c746524-978d-4ccf-9310-1c436d0934a6 HTTP/1.1" status: 200 len: 217 time: 0.0466790 Dec 08 11:47:06.396249 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3cf44dfd-8768-4b92-a22e-ac9327e3f4d3 req-34aba384-051f-4a8b-b100-9eb3d3479ed9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0904846 Dec 08 11:47:06.441959 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-8192a266-cda1-49c0-9cb9-9a27a45b4a3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:06.443414 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-8192a266-cda1-49c0-9cb9-9a27a45b4a3d service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0522208 Dec 08 11:47:06.489121 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb415836-abb2-4e0e-b6ed-e935e6070c12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:06.490611 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-fb415836-abb2-4e0e-b6ed-e935e6070c12 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0400703 Dec 08 11:47:06.580994 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-9ef5027e-0962-4f15-af41-251046b44a6b service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829875 Dec 08 11:47:06.667397 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6577b3cf-3fee-4f9d-83c0-dc1dd5892e0e req-5308e050-0146-415c-b5c6-a619ec124921 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0798733 Dec 08 11:47:06.759180 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-d1bc42aa-8a2a-430b-9b96-106528b90e39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:06.760655 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-d1bc42aa-8a2a-430b-9b96-106528b90e39 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 1096 time: 0.0460379 Dec 08 11:47:06.848127 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-c7459656-878a-41ac-85b2-009976dcbe69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:06.849523 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-c7459656-878a-41ac-85b2-009976dcbe69 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.0813000 Dec 08 11:47:06.893290 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-8532d64a-51a5-461f-9bb1-6bb3e299e442 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5c746524-978d-4ccf-9310-1c436d0934a6 HTTP/1.1" status: 200 len: 217 time: 0.0369129 Dec 08 11:47:06.940139 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-2316aeef-442d-4a03-b6f0-f28e7f14ca6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:06.941538 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-2316aeef-442d-4a03-b6f0-f28e7f14ca6a service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0418074 Dec 08 11:47:06.985399 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-37d81d18-1b07-4858-8229-5a45931b8c40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:06.986832 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-37d81d18-1b07-4858-8229-5a45931b8c40 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0388939 Dec 08 11:47:07.083325 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-8ca1088d-dd23-4b5b-8a5e-821ce4359474 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893190 Dec 08 11:47:07.169742 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-53908a1c-096f-4134-98ae-2974b9cc56b3 req-114eaa7c-fd49-4e1a-899b-f6e719fa5496 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0794778 Dec 08 11:47:07.511858 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fe58b56-4c2f-43a4-9e1a-5de0984ec54a req-69821f5d-b63d-4ffe-87e8-29e1d535130f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:07.513584 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3fe58b56-4c2f-43a4-9e1a-5de0984ec54a req-69821f5d-b63d-4ffe-87e8-29e1d535130f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 943 time: 0.0473404 Dec 08 11:47:07.561456 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-3fe58b56-4c2f-43a4-9e1a-5de0984ec54a req-409b0695-2afb-4102-9443-e226482df3a2 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414305 Dec 08 11:47:07.888345 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:47:08.678532 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-380e2f6d-17b4-48b7-83a3-542be17fe536 req-21d5975d-714c-4cef-ad0a-9d5f3842f498 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:08.679960 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-380e2f6d-17b4-48b7-83a3-542be17fe536 req-21d5975d-714c-4cef-ad0a-9d5f3842f498 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 943 time: 0.0511847 Dec 08 11:47:08.726841 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-380e2f6d-17b4-48b7-83a3-542be17fe536 req-f3ecf8a3-8747-4dbc-8ff2-5d65a6877eae tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410061 Dec 08 11:47:09.838817 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3539d67-c75e-42a3-828c-395effd41ee5 req-94121974-1e90-4e42-bd0f-3183c3a5ffcd tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:09.840257 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d3539d67-c75e-42a3-828c-395effd41ee5 req-94121974-1e90-4e42-bd0f-3183c3a5ffcd tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 943 time: 0.0472445 Dec 08 11:47:09.887889 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d3539d67-c75e-42a3-828c-395effd41ee5 req-d7454e51-2453-4155-8d66-e485a2886242 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412810 Dec 08 11:47:11.001060 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2856fc5-1fe6-4170-b4a8-b72e60eb3c18 req-93d493f0-0108-4425-a7a1-22d4cf7ec717 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:11.002438 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f2856fc5-1fe6-4170-b4a8-b72e60eb3c18 req-93d493f0-0108-4425-a7a1-22d4cf7ec717 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 943 time: 0.0506957 Dec 08 11:47:11.049683 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f2856fc5-1fe6-4170-b4a8-b72e60eb3c18 req-c7dfa806-bd0f-47dd-a59c-5ff7046be6db tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413990 Dec 08 11:47:12.164892 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ef90b91-e6d1-43f8-9a3f-4bd156e7e7ab req-df993de7-bcf0-4e95-aeab-4a11e6a050f5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:12.166359 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8ef90b91-e6d1-43f8-9a3f-4bd156e7e7ab req-df993de7-bcf0-4e95-aeab-4a11e6a050f5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 943 time: 0.0484538 Dec 08 11:47:12.213220 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-8ef90b91-e6d1-43f8-9a3f-4bd156e7e7ab req-dca2c79b-2d65-453f-91b5-afad8c6a1700 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410349 Dec 08 11:47:13.324198 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d05747-396f-4496-8e03-a02e1d2d281b req-292a315a-e6fc-4795-a352-64c859cb293c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:13.325658 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-79d05747-396f-4496-8e03-a02e1d2d281b req-292a315a-e6fc-4795-a352-64c859cb293c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 943 time: 0.0470319 Dec 08 11:47:13.376519 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-79d05747-396f-4496-8e03-a02e1d2d281b req-e53b8a7a-b436-4ad4-88be-eab2291e9cdb tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449705 Dec 08 11:47:14.021101 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 5c746524-978d-4ccf-9310-1c436d0934a6 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:47:14.114308 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 5c746524-978d-4ccf-9310-1c436d0934a6, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=5c746524-978d-4ccf-9310-1c436d0934a6,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:47:14.125732 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': '5c746524-978d-4ccf-9310-1c436d0934a6', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'port_id': '5c746524-978d-4ccf-9310-1c436d0934a6', 'mac_address': 'fa:16:3e:1f:45:81', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 258, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:47:14.160987 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:14.172927 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5c746524-978d-4ccf-9310-1c436d0934a6 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:47:14.192248 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 5c746524-978d-4ccf-9310-1c436d0934a6, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=5c746524-978d-4ccf-9310-1c436d0934a6,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:47:14.196333 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:14.244766 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=5c746524-978d-4ccf-9310-1c436d0934a6,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:47:14.253990 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:14.254319 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:14.254733 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:14.255082 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:14.255523 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:14.255884 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:14.256258 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:14.256636 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:14.257022 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:14.257475 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:14.257817 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:14.258128 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:14.258532 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:14.487479 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84689976-ad82-4e30-8962-994d61f7667c req-08708a7c-d46f-4391-9ec6-32397b6f6f5f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:14.488908 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-84689976-ad82-4e30-8962-994d61f7667c req-08708a7c-d46f-4391-9ec6-32397b6f6f5f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 944 time: 0.0466974 Dec 08 11:47:14.515944 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['5c746524-978d-4ccf-9310-1c436d0934a6'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:47:14.537098 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-84689976-ad82-4e30-8962-994d61f7667c req-95c7c87a-bbd0-45c4-9ba0-90e6c359ad03 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422974 Dec 08 11:47:15.647602 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2a50bc3-e166-458d-8095-816ecb7db11c req-075e2afb-5576-4732-9189-0022f6f9fa0a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:15.649047 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c2a50bc3-e166-458d-8095-816ecb7db11c req-075e2afb-5576-4732-9189-0022f6f9fa0a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 944 time: 0.0474308 Dec 08 11:47:15.697720 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c2a50bc3-e166-458d-8095-816ecb7db11c req-1be7826c-fc29-4d21-80ec-76f02a2734f6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428231 Dec 08 11:47:16.040073 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 5c746524-978d-4ccf-9310-1c436d0934a6 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:47:16.095928 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port 5c746524-978d-4ccf-9310-1c436d0934a6 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:47:16.099951 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port 5c746524-978d-4ccf-9310-1c436d0934a6 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:47:16.100321 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:16.173555 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:16.194897 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c746524-978d-4ccf-9310-1c436d0934a6'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:47:16.197079 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-84b8a0f7-f60b-4b7a-97a1-2a8a320a93c7" -d '{"events": [{"server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "name": "network-vif-plugged", "status": "completed", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:47:16.210253 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port 5c746524-978d-4ccf-9310-1c436d0934a6, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=5c746524-978d-4ccf-9310-1c436d0934a6,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:47:16.214144 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:16.239009 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:47:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-77288828-95f3-42ea-9886-aaa2e099ccee x-openstack-request-id: req-77288828-95f3-42ea-9886-aaa2e099ccee {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:47:16.239294 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "name": "network-vif-plugged", "status": "completed", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:47:16.239549 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-77288828-95f3-42ea-9886-aaa2e099ccee {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:47:16.239925 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c746524-978d-4ccf-9310-1c436d0934a6', 'code': 200} Dec 08 11:47:16.267434 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=5c746524-978d-4ccf-9310-1c436d0934a6,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:47:16.442565 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c305d6ab-cffc-45d1-b13f-b8936c7ddd90 req-8d95d948-bf57-4a23-83c3-b375340520a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:16.444015 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c305d6ab-cffc-45d1-b13f-b8936c7ddd90 req-8d95d948-bf57-4a23-83c3-b375340520a9 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 1098 time: 0.0429640 Dec 08 11:47:16.488881 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-c305d6ab-cffc-45d1-b13f-b8936c7ddd90 req-59a97b49-9ab4-48c1-b774-5d9c7cd0549a service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380857 Dec 08 11:47:16.808389 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-275d6bbd-4c50-48bd-b9c9-faf9f05c2440 req-f5181c3f-3588-4ccb-8ef9-14a57b634628 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:16.809851 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-275d6bbd-4c50-48bd-b9c9-faf9f05c2440 req-f5181c3f-3588-4ccb-8ef9-14a57b634628 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 945 time: 0.0474966 Dec 08 11:47:16.857322 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-275d6bbd-4c50-48bd-b9c9-faf9f05c2440 req-c4c7c08f-d44a-49b3-a3b7-f8c8c45958a1 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410051 Dec 08 11:47:17.728905 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:17.971020 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf2f22d-e61c-467c-9882-f9934cc52b68 req-3d19c4e2-eb00-4050-99aa-deb52b4362d1 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:17.972434 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dcf2f22d-e61c-467c-9882-f9934cc52b68 req-3d19c4e2-eb00-4050-99aa-deb52b4362d1 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 945 time: 0.0465710 Dec 08 11:47:18.022111 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-dcf2f22d-e61c-467c-9882-f9934cc52b68 req-367a95a1-ccf0-4e3e-9bdf-b9fb986267ca tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438035 Dec 08 11:47:18.132321 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a59c6b83-2f82-49b3-81d9-b3035836d945 req-6346ad7f-32b3-492d-b122-638a29c83dca tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:18.133807 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a59c6b83-2f82-49b3-81d9-b3035836d945 req-6346ad7f-32b3-492d-b122-638a29c83dca tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 945 time: 0.0478106 Dec 08 11:47:18.182065 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a59c6b83-2f82-49b3-81d9-b3035836d945 req-75a1d6f5-e5a5-4428-9b30-d8099bf31f80 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421531 Dec 08 11:47:18.203931 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 33204) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:47:18.243159 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e41cb6fc-8f23-4041-88a9-8760a60ecbf2 tempest-TestVolumeBootPattern-1413654375 tempest-TestVolumeBootPattern-1413654375-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102317) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:18.244642 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-e41cb6fc-8f23-4041-88a9-8760a60ecbf2 tempest-TestVolumeBootPattern-1413654375 tempest-TestVolumeBootPattern-1413654375-project-admin] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 1093 time: 0.0390856 Dec 08 11:47:18.247393 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 33208) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:47:18.251642 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.v2.base [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Request body: {'floatingip': {'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'port_id': '5c746524-978d-4ccf-9310-1c436d0934a6', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address': '172.20.0.5'}} {{(pid=102317) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:47:18.273378 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for floatingip, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:18.368930 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:18.471280 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.db_base_plugin_common [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Allocated IP 172.27.2.25 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/8c769dc5-d667-4eab-bee2-a8c1ebaf3735) {{(pid=102317) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:47:18.573632 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for port, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:18.606177 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:18.642134 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102317) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:47:18.644880 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.base_scheduler [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Resources bound (agent type, host, resource id): {{(pid=102317) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:47:18.650307 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.db.l3_dvrscheduler_db [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Received port after_create {{(pid=102317) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:47:18.679523 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'Port': ['ID=8c769dc5-d667-4eab-bee2-a8c1ebaf3735,revision_number=1']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:47:18.692527 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:18.692876 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:18.693240 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:18.693582 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:18.693916 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:18.694244 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:18.694570 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:18.694895 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:18.695218 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:18.695540 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:18.695868 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:18.696184 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:18.696502 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:47:19.014909 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:19.082115 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:19.231954 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for port, precommit_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:19.236594 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5648421'] for port, after_update {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:19.304844 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'Port': ['ID=8c769dc5-d667-4eab-bee2-a8c1ebaf3735,revision_number=2']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:47:19.315903 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_create {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:19.413231 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.db.l3_db [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Floating IP e2b870c9-385e-489a-bcd5-ac3e393ed053 associated. External IP: 172.27.2.25, port: 5c746524-978d-4ccf-9310-1c436d0934a6. Dec 08 11:47:19.612828 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Router 234433de-4188-442f-b5ef-12253c2924c3 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:47:19.714898 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:47:19.725108 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74b0f22c-6635-4757-b629-65fecb1aebd1 None None] Sync routers for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:47:19.732882 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:19.734124 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74b0f22c-6635-4757-b629-65fecb1aebd1 None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:47:19.734724 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-74b0f22c-6635-4757-b629-65fecb1aebd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:46:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:47:19.955189 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-effe4711-a6d6-42ea-b650-1ef6110c1a6d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.7066476 Dec 08 11:47:19.955671 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'tag': '5c746524-978d-4ccf-9310-1c436d0934a6'}] {{(pid=102317) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:47:19.958455 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}212dae370a2b559de5b7d578af79073c1e0f4cb02126db35c6693ef88f95633e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb" -d '{"events": [{"name": "network-changed", "server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6"}]}' {{(pid=102317) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:47:19.974062 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-74b0f22c-6635-4757-b629-65fecb1aebd1 None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:47:20.054056 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:47:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-16f6619b-450b-4309-8c97-5511583539ac x-openstack-request-id: req-16f6619b-450b-4309-8c97-5511583539ac {{(pid=102317) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:47:20.054348 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6", "status": "completed", "code": 200}]} {{(pid=102317) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:47:20.054610 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-16f6619b-450b-4309-8c97-5511583539ac {{(pid=102317) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:47:20.055008 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'tag': '5c746524-978d-4ccf-9310-1c436d0934a6', 'status': 'completed', 'code': 200} Dec 08 11:47:20.120170 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-00233473-2c1b-4781-a77f-be92b5cbf5b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:20.121702 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-00233473-2c1b-4781-a77f-be92b5cbf5b9 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 1098 time: 0.0409286 Dec 08 11:47:20.197927 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-74b0f22c-6635-4757-b629-65fecb1aebd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'e2b870c9-385e-489a-bcd5-ac3e393ed053', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.25', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': '5c746524-978d-4ccf-9310-1c436d0934a6', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:1f:45:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:47:18Z', 'updated_at': '2021-12-08T11:47:18Z', 'revision_number': 0, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:47:20.213246 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-8ca7c119-21bc-4053-a7bd-4311507d87b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:20.214654 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-8ca7c119-21bc-4053-a7bd-4311507d87b8 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.0853915 Dec 08 11:47:20.224369 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74b0f22c-6635-4757-b629-65fecb1aebd1 None None] Checking router: 234433de-4188-442f-b5ef-12253c2924c3 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:47:20.234143 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74b0f22c-6635-4757-b629-65fecb1aebd1 None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:47:20.234753 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-74b0f22c-6635-4757-b629-65fecb1aebd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:46:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:47:20.283400 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-fe88f396-2f71-4c10-805d-2d1c35a085d5 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5c746524-978d-4ccf-9310-1c436d0934a6 HTTP/1.1" status: 200 len: 998 time: 0.0582023 Dec 08 11:47:20.333998 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-c695bf6a-4ecc-4a66-8b96-3b724dfc52bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:20.335467 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-c695bf6a-4ecc-4a66-8b96-3b724dfc52bf service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0455937 Dec 08 11:47:20.339336 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-74b0f22c-6635-4757-b629-65fecb1aebd1 None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:47:20.568250 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-74b0f22c-6635-4757-b629-65fecb1aebd1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'e2b870c9-385e-489a-bcd5-ac3e393ed053', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.25', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': '5c746524-978d-4ccf-9310-1c436d0934a6', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:1f:45:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:47:18Z', 'updated_at': '2021-12-08T11:47:18Z', 'revision_number': 0, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:47:20.599128 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-74b0f22c-6635-4757-b629-65fecb1aebd1 None None] The sync data for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi is: [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'e2b870c9-385e-489a-bcd5-ac3e393ed053', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.25', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': '5c746524-978d-4ccf-9310-1c436d0934a6', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:1f:45:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:47:18Z', 'updated_at': '2021-12-08T11:47:18Z', 'revision_number': 0, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:47:20.652080 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-672d03cd-d4ec-43a2-a8a6-7e8c30d36600 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:20.653852 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-672d03cd-d4ec-43a2-a8a6-7e8c30d36600 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3116133 Dec 08 11:47:20.744190 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-6377f13a-510c-4b72-b14c-786fe29d7724 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820763 Dec 08 11:47:20.787809 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-269a66b1-f3b0-43ba-b4db-20b86032dba2 None None] New status for floating IP e2b870c9-385e-489a-bcd5-ac3e393ed053: ACTIVE {{(pid=102320) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:47:20.839230 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a92c3b46-7e61-4bbf-80c1-aca72051ddeb req-a520ba20-1b81-433d-b1a8-ac8bc2467674 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0871706 Dec 08 11:47:22.503014 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-953dfcd0-a38c-4d64-885f-f6cfbbeb6403 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:24.662596 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-304d556c-a924-45f2-b0e9-bd212150946d req-cd37e5c9-1fba-4c28-98d5-f8502673fedf service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0391667 Dec 08 11:47:24.731010 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1ae8eff0-c31b-4430-8744-7808af23935c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:24.767473 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-304d556c-a924-45f2-b0e9-bd212150946d req-52528fe0-ce40-476d-bcfa-dc65c81a469d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:24.768954 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-304d556c-a924-45f2-b0e9-bd212150946d req-52528fe0-ce40-476d-bcfa-dc65c81a469d service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 1098 time: 0.0458415 Dec 08 11:47:24.872802 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-304d556c-a924-45f2-b0e9-bd212150946d req-093202c7-c845-4d22-9290-3717a03e182e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:24.874282 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-304d556c-a924-45f2-b0e9-bd212150946d req-093202c7-c845-4d22-9290-3717a03e182e service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.0843871 Dec 08 11:47:24.937965 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-304d556c-a924-45f2-b0e9-bd212150946d req-b230a684-7e0d-47f2-be91-718d75a3560b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5c746524-978d-4ccf-9310-1c436d0934a6 HTTP/1.1" status: 200 len: 1000 time: 0.0562623 Dec 08 11:47:24.991218 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-304d556c-a924-45f2-b0e9-bd212150946d req-4fdac092-b3b9-4f5a-adfe-cbbb8f942e3e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:24.992642 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-304d556c-a924-45f2-b0e9-bd212150946d req-4fdac092-b3b9-4f5a-adfe-cbbb8f942e3e service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0479944 Dec 08 11:47:25.038157 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-304d556c-a924-45f2-b0e9-bd212150946d req-8f15446a-5c07-4622-af17-048a7f0a3f56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:47:25.039591 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-304d556c-a924-45f2-b0e9-bd212150946d req-8f15446a-5c07-4622-af17-048a7f0a3f56 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0390713 Dec 08 11:47:25.128684 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-304d556c-a924-45f2-b0e9-bd212150946d req-288ccd5a-5b9f-4d6c-9bc5-7923060b26bb service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0805335 Dec 08 11:47:25.218894 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-304d556c-a924-45f2-b0e9-bd212150946d req-f7fa3241-dbf6-4c70-88d7-f37bd21e7819 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0830350 Dec 08 11:47:25.839038 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:27.191304 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:28.183770 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:44.886439 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:47:47.724554 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:52.509921 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-45d4d918-e686-4082-a980-ab9a74a38385 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:54.733467 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-5ec7291c-2b97-40c5-930b-a386989b4300 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:55.842618 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:57.194563 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:47:58.187004 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:48:11.216267 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [req-961e1513-908e-41ce-9c49-4da90b3d6ebe req-c9b520e8-53fa-4106-a0a4-10f14a877310 service neutron] (102317) timed out ('10.222.0.61', 56777) {{(pid=102317) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 08 11:48:17.733108 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:48:21.884844 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:48:22.501000 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2be5747e-f4f4-4e27-9542-2aff7fe60c32 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:48:24.647928 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f8499b0f-4c8e-4f03-b1c9-ef77689b9c4c req-033622f9-75df-4a41-9554-d94cff379dcd service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0381761 Dec 08 11:48:24.730458 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8499b0f-4c8e-4f03-b1c9-ef77689b9c4c req-dd086fbd-bb95-4122-b389-e1608f6f600f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:48:24.731940 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f8499b0f-4c8e-4f03-b1c9-ef77689b9c4c req-dd086fbd-bb95-4122-b389-e1608f6f600f service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 1098 time: 0.0399003 Dec 08 11:48:24.734631 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-46446cd2-b0e9-419e-b2fd-a64ea8df8c3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:48:24.836768 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8499b0f-4c8e-4f03-b1c9-ef77689b9c4c req-4db92916-d6fd-4364-ba05-fee0156fdb45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:48:24.838244 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f8499b0f-4c8e-4f03-b1c9-ef77689b9c4c req-4db92916-d6fd-4364-ba05-fee0156fdb45 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.0858424 Dec 08 11:48:24.904519 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f8499b0f-4c8e-4f03-b1c9-ef77689b9c4c req-479f5454-e0d2-46a6-acdb-0d47a29e2c83 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5c746524-978d-4ccf-9310-1c436d0934a6 HTTP/1.1" status: 200 len: 1000 time: 0.0564840 Dec 08 11:48:24.958255 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8499b0f-4c8e-4f03-b1c9-ef77689b9c4c req-eb7bbce0-ad59-4de7-a77c-8995fbd2c093 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:48:24.959659 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f8499b0f-4c8e-4f03-b1c9-ef77689b9c4c req-eb7bbce0-ad59-4de7-a77c-8995fbd2c093 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0452597 Dec 08 11:48:25.004472 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8499b0f-4c8e-4f03-b1c9-ef77689b9c4c req-b8700b61-643c-4069-9a3a-44381e71eca3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:48:25.005971 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f8499b0f-4c8e-4f03-b1c9-ef77689b9c4c req-b8700b61-643c-4069-9a3a-44381e71eca3 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0382054 Dec 08 11:48:25.094632 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f8499b0f-4c8e-4f03-b1c9-ef77689b9c4c req-bde2fea4-778b-4e4f-bb1c-cc5bc14a8e5a service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800865 Dec 08 11:48:25.185748 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f8499b0f-4c8e-4f03-b1c9-ef77689b9c4c req-2fabae7c-d4b7-4489-ba6d-c6c742212789 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828137 Dec 08 11:48:25.847033 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:48:27.196349 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:48:28.188482 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:48:34.475620 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [req-cd79dde4-045f-475a-87d0-3ddd84e483eb req-c98b574e-2562-4cd3-9281-1f9f993649d0 service neutron] (102317) timed out ('10.222.0.61', 56898) {{(pid=102317) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 08 11:48:47.739318 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:48:52.504273 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-6426c4d2-a4a6-4b26-9676-9ae8ebca4753 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:48:54.736695 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-ac5d9065-c6e8-4ffb-9130-1af5b1a606de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:48:55.848229 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:48:57.200324 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:48:58.194225 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:48:58.883706 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:49:17.729500 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:21.424246 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-57b5917c-7d1b-414d-96e7-045a852dd9ff tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1598406315&fields=id&tenant_id=8cd51b040b7242d084a290de749786b8 HTTP/1.1" status: 200 len: 267 time: 0.0446997 Dec 08 11:49:21.531522 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-b53f3f40-9e0c-413d-ab5c-d9a38aa7d891 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:21.532955 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-b53f3f40-9e0c-413d-ab5c-d9a38aa7d891 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 812 time: 0.1021037 Dec 08 11:49:21.547837 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-15a1a508-0d35-44f0-abbc-2683995d2c48 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/quotas/8cd51b040b7242d084a290de749786b8 HTTP/1.1" status: 200 len: 375 time: 0.0091877 Dec 08 11:49:21.597495 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-35de0088-5446-4c8f-bea1-797becbd5d0d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0444348 Dec 08 11:49:21.671576 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-39e56244-7e69-4af0-8b1b-299430e3b023 service neutron] http://10.222.0.66:9696/v2.0/extensions returned with HTTP 200 {{(pid=102318) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 08 11:49:21.672571 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-39e56244-7e69-4af0-8b1b-299430e3b023 service neutron] 10.222.0.66 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0632737 Dec 08 11:49:21.758024 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-4f729759-b933-4cbb-a7f0-666e774a5042 service neutron] 10.222.0.66 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0791457 Dec 08 11:49:21.846847 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-fe71fcc8-a1e5-4b77-b352-52a5f3e3695d service neutron] 10.222.0.66 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819201 Dec 08 11:49:22.505208 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-aea02704-74e8-4c8c-9d2a-caa4be8bd8ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:23.139698 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-089ed9f3-73c6-4681-be53-73e5f0a42508 req-1619e1c7-0f90-4175-aede-ad2bdb51e5b3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 210 time: 0.0265527 Dec 08 11:49:24.214876 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6dc49d2a-d762-48bb-b747-2de13196d96c req-4c4e45cb-3063-4f35-9d02-ec8aba6767c9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 210 time: 0.0253592 Dec 08 11:49:24.737690 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-714ebd0a-c85b-46e9-8df5-4500c37aa2b4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:25.294794 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-32141920-67cd-4821-a2eb-765e67146fc3 req-46d07f6f-6052-4d20-ac74-7467124177c6 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 210 time: 0.0275970 Dec 08 11:49:25.849783 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:26.377597 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-90d507a8-9c4e-4031-82d0-98c834a9dbb8 req-8cee47bb-aaec-4df3-be52-8b61bd6c42dd tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 210 time: 0.0296557 Dec 08 11:49:26.687866 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5812d3d-07b0-4411-870d-4d19d63c2fdc req-cf9972be-4538-4a5f-8e2f-9de33f0a820b service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0806684 Dec 08 11:49:26.769256 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5812d3d-07b0-4411-870d-4d19d63c2fdc req-9a62c7c3-1eda-4df1-a874-0c1def51db02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:26.770771 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5812d3d-07b0-4411-870d-4d19d63c2fdc req-9a62c7c3-1eda-4df1-a874-0c1def51db02 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 1098 time: 0.0403554 Dec 08 11:49:26.875328 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5812d3d-07b0-4411-870d-4d19d63c2fdc req-b858149c-866b-41e1-98a3-0314b593b1cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:26.876783 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5812d3d-07b0-4411-870d-4d19d63c2fdc req-b858149c-866b-41e1-98a3-0314b593b1cf service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.0867388 Dec 08 11:49:26.940220 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5812d3d-07b0-4411-870d-4d19d63c2fdc req-0068f540-d3de-40ad-9417-81d6456f20cf service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5c746524-978d-4ccf-9310-1c436d0934a6 HTTP/1.1" status: 200 len: 1000 time: 0.0566065 Dec 08 11:49:26.988403 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5812d3d-07b0-4411-870d-4d19d63c2fdc req-613ad764-f800-48aa-947e-229c31ba6761 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:26.989810 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5812d3d-07b0-4411-870d-4d19d63c2fdc req-613ad764-f800-48aa-947e-229c31ba6761 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0416770 Dec 08 11:49:27.038948 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5812d3d-07b0-4411-870d-4d19d63c2fdc req-6a334fa0-99eb-4457-ab61-36c931e2ed49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:27.040784 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5812d3d-07b0-4411-870d-4d19d63c2fdc req-6a334fa0-99eb-4457-ab61-36c931e2ed49 service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0435629 Dec 08 11:49:27.127416 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5812d3d-07b0-4411-870d-4d19d63c2fdc req-5944089e-3de8-4089-9558-24f44b511221 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0797889 Dec 08 11:49:27.203197 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:27.221803 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e5812d3d-07b0-4411-870d-4d19d63c2fdc req-d07d3c7a-a726-42f2-a2a7-996387856ff6 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868051 Dec 08 11:49:27.469498 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-108bb857-ec68-4cd8-8b0f-d553f78024a0 req-19a1dd50-0bfc-4236-b5af-347029954bdb tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 210 time: 0.0262988 Dec 08 11:49:28.161852 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-16038fe3-dba0-4a35-a212-93351f4fb110 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:28.163289 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-16038fe3-dba0-4a35-a212-93351f4fb110 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 812 time: 0.1040781 Dec 08 11:49:28.196702 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:28.235151 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-6e3b8502-e006-4892-9ba3-cb5a53d6b46e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8cd51b040b7242d084a290de749786b8 HTTP/1.1" status: 200 len: 380 time: 0.0597005 Dec 08 11:49:28.244762 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Request body: {'port': {'device_id': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'admin_state_up': True, 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'security_groups': ['e47b7911-1842-43a5-a5fe-dedb91083734']}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:49:28.349200 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Made reservation on behalf of 8cd51b040b7242d084a290de749786b8 for: {'port': 1} {{(pid=102318) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 08 11:49:28.352591 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:28.476192 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Allocated IP 172.20.0.11 (b6155a6c-7a89-4b5b-b3cb-d77c93560254/4923b9ae-1dff-4272-9f7a-1921aac84705/b00da941-b960-42cc-9123-d755131a0179) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:49:28.606123 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2e963a87-9805-43b3-a66a-9f880e0f4a9c req-da45c7bb-2c2b-45ec-b8b1-19b19c420a24 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 210 time: 0.0455711 Dec 08 11:49:28.649961 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:28.682608 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:28.723579 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Network b6155a6c-7a89-4b5b-b3cb-d77c93560254 is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:49:28.728434 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:49:28.732156 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:49:28.738991 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'Port': ['ID=b00da941-b960-42cc-9123-d755131a0179,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:49:28.766642 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:28.766984 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:28.767325 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:28.767659 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:28.767989 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:28.768316 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:28.768648 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:28.768972 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:28.769325 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:28.769651 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:28.769973 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:28.770289 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:28.770688 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:28.796747 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:28.797376 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:28.813430 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-c81048fd-b6df-46ae-8075-ce216f38c5d0 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5721741 Dec 08 11:49:28.827297 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Request body: {'port': {'device_id': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81977'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:49:28.885389 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:28.922249 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-bdb9fb0f-c626-42ec-9478-13c2aea42620 None None] Provisioning complete for port b00da941-b960-42cc-9123-d755131a0179 triggered by entity DHCP. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:49:28.922858 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-bdb9fb0f-c626-42ec-9478-13c2aea42620 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:28.958876 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-bdb9fb0f-c626-42ec-9478-13c2aea42620 None None] Port b00da941-b960-42cc-9123-d755131a0179 cannot update to ACTIVE because it is not bound. {{(pid=102319) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 08 11:49:29.135345 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b00da941-b960-42cc-9123-d755131a0179 {{(pid=102318) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:49:29.143436 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:29.155555 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.provisioning_blocks [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Transition to ACTIVE for port object b00da941-b960-42cc-9123-d755131a0179 will not be triggered until provisioned by entity L2. {{(pid=102318) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 08 11:49:29.159443 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:29.206647 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Pushing event updated for resources: {'Port': ['ID=b00da941-b960-42cc-9123-d755131a0179,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:49:29.279086 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Attempting to bind port b00da941-b960-42cc-9123-d755131a0179 on host hv-cinder-81977 for vnic_type normal with profile {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 08 11:49:29.280021 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Attempting to bind port b00da941-b960-42cc-9123-d755131a0179 by drivers openvswitch,hyperv on host hv-cinder-81977 at level 0 using segments [{'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 08 11:49:29.280350 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Attempting to bind port b00da941-b960-42cc-9123-d755131a0179 on network b6155a6c-7a89-4b5b-b3cb-d77c93560254 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:49:29.285637 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Port b00da941-b960-42cc-9123-d755131a0179 on network b6155a6c-7a89-4b5b-b3cb-d77c93560254 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81977 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 08 11:49:29.285959 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Attempting to bind port b00da941-b960-42cc-9123-d755131a0179 on network b6155a6c-7a89-4b5b-b3cb-d77c93560254 {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 08 11:49:29.290881 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Checking agent: {'id': '7e230f63-4f7e-4e0d-a1b6-b0defdc2ade5', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81977', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'started_at': datetime.datetime(2021, 12, 8, 11, 29, 18), 'heartbeat_timestamp': datetime.datetime(2021, 12, 8, 11, 49, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 08 11:49:29.291224 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Checking segment: {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102318) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 08 11:49:29.291603 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Bound using segment: {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'} {{(pid=102318) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 08 11:49:29.292030 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.managers [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Bound port: b00da941-b960-42cc-9123-d755131a0179, host: hv-cinder-81977, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 258, 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254'}}] {{(pid=102318) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 08 11:49:29.292383 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:29.354781 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] For port b00da941-b960-42cc-9123-d755131a0179, host hv-cinder-81977, cleared binding levels {{(pid=102318) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 08 11:49:29.358076 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] For port b00da941-b960-42cc-9123-d755131a0179, host hv-cinder-81977, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=b00da941-b960-42cc-9123-d755131a0179,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102318) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 08 11:49:29.362579 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:29.395583 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:29.396201 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:29.397599 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] 10.222.0.61 "PUT /v2.0/ports/b00da941-b960-42cc-9123-d755131a0179 HTTP/1.1" status: 200 len: 1094 time: 0.5745616 Dec 08 11:49:29.398084 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'tag': 'b00da941-b960-42cc-9123-d755131a0179'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:49:29.400260 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61" -d '{"events": [{"name": "network-changed", "server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "tag": "b00da941-b960-42cc-9123-d755131a0179"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:49:29.436996 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47a2494e-40dc-4e39-a891-903cb18950f2 service neutron] Pushing event updated for resources: {'Port': ['ID=b00da941-b960-42cc-9123-d755131a0179,revision_number=3']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:49:29.448774 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:49:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6883dda0-141a-4066-a677-829528fa1797 x-openstack-request-id: req-6883dda0-141a-4066-a677-829528fa1797 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:49:29.449141 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "tag": "b00da941-b960-42cc-9123-d755131a0179", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:49:29.449431 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-6883dda0-141a-4066-a677-829528fa1797 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:49:29.449832 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'tag': 'b00da941-b960-42cc-9123-d755131a0179', 'status': 'completed', 'code': 200} Dec 08 11:49:29.487694 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-1d7552bf-86eb-4f49-8c34-474e21ccbf4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:29.489268 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-1d7552bf-86eb-4f49-8c34-474e21ccbf4b service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 1097 time: 0.0493007 Dec 08 11:49:29.534053 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-17360b02-4dfa-4cf2-b97d-2cd33638e89d service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b00da941-b960-42cc-9123-d755131a0179 HTTP/1.1" status: 200 len: 217 time: 0.0358844 Dec 08 11:49:29.584794 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-d6a941a6-3949-43b0-bf2f-043625c20164 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:29.586293 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-d6a941a6-3949-43b0-bf2f-043625c20164 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0442731 Dec 08 11:49:29.635597 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-73788201-728a-49bf-96db-d52ff834c47e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:29.636817 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-73788201-728a-49bf-96db-d52ff834c47e service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0432198 Dec 08 11:49:29.755614 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-234e0997-0484-4b68-a676-4e283fca5436 req-277d4a14-5949-4af8-94b3-0a6fcafcb4fa tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:29.757049 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-234e0997-0484-4b68-a676-4e283fca5436 req-277d4a14-5949-4af8-94b3-0a6fcafcb4fa tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 944 time: 0.0729413 Dec 08 11:49:29.762234 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-61c260c9-1e3e-4571-af6a-5789734f34aa service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1172681 Dec 08 11:49:29.852993 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-234e0997-0484-4b68-a676-4e283fca5436 req-a79c8c3e-baea-405f-b5c5-6b434d2b1a65 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0895603 Dec 08 11:49:29.884125 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-a7a8cea2-bcf1-4e1b-963c-edd043132574 req-77b55114-3245-42a0-8e4e-833a8176cc88 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1137626 Dec 08 11:49:30.022720 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-6bff4be0-6232-423d-b1ed-7451487d8501 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:30.024171 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-6bff4be0-6232-423d-b1ed-7451487d8501 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 1097 time: 0.0408618 Dec 08 11:49:30.115445 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-28e3c346-eb3d-403e-8a20-9dd59db90b6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:30.116931 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-28e3c346-eb3d-403e-8a20-9dd59db90b6b service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.0854368 Dec 08 11:49:30.157537 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-5a63036c-8427-480a-8e9e-b55d5f5222a6 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b00da941-b960-42cc-9123-d755131a0179 HTTP/1.1" status: 200 len: 217 time: 0.0329432 Dec 08 11:49:30.208766 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-8db03544-9601-4dfc-bb08-f579974e7986 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:30.210264 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-8db03544-9601-4dfc-bb08-f579974e7986 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0456324 Dec 08 11:49:30.254516 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-7e016468-0c08-46a5-ae51-bc452903829a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:30.255995 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-7e016468-0c08-46a5-ae51-bc452903829a service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0392201 Dec 08 11:49:30.342308 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-de4d1e38-7c6f-48a5-84f9-ba94761fbf5f service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0779710 Dec 08 11:49:30.431590 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5a7ca18b-bcc1-4d3e-b605-005f2e74fb61 req-c7024bc5-e73b-4716-ab0c-b3ce9b3cf578 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819604 Dec 08 11:49:30.969886 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ffc3dc-da48-4780-ace6-b7211f70c915 req-601235a1-978c-4937-bf4c-f41e726ca96d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:30.971326 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e2ffc3dc-da48-4780-ace6-b7211f70c915 req-601235a1-978c-4937-bf4c-f41e726ca96d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 944 time: 0.0484412 Dec 08 11:49:31.019495 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-e2ffc3dc-da48-4780-ace6-b7211f70c915 req-0a6f4d53-16b7-4fc9-95e1-c59094b1ab6c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421247 Dec 08 11:49:32.136417 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f0c08aa-7876-4bb4-8019-df13dd403320 req-d51cff4e-8b15-4fa6-a7d2-26b297725a1d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:32.138183 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6f0c08aa-7876-4bb4-8019-df13dd403320 req-d51cff4e-8b15-4fa6-a7d2-26b297725a1d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 944 time: 0.0532229 Dec 08 11:49:32.185102 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-6f0c08aa-7876-4bb4-8019-df13dd403320 req-5be98859-1b4d-4157-819a-7bac0071d88e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411260 Dec 08 11:49:33.297762 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76f8570f-5ed7-4691-a0ce-971b17201602 req-e2501107-691c-45b6-a983-9583c30e7cc4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:33.299226 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-76f8570f-5ed7-4691-a0ce-971b17201602 req-e2501107-691c-45b6-a983-9583c30e7cc4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 944 time: 0.0483692 Dec 08 11:49:33.346769 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-76f8570f-5ed7-4691-a0ce-971b17201602 req-94e021f1-3a1e-4143-9f9b-0a5bf35443b9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415654 Dec 08 11:49:34.458235 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30dd4cbf-bf12-4e84-9a14-a6886aee8000 req-0e173f38-33db-4485-918e-64e0cb2c3651 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:34.459669 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-30dd4cbf-bf12-4e84-9a14-a6886aee8000 req-0e173f38-33db-4485-918e-64e0cb2c3651 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 944 time: 0.0469134 Dec 08 11:49:34.509850 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-30dd4cbf-bf12-4e84-9a14-a6886aee8000 req-d11dd443-5b21-407e-9579-83fa6072a33f tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443561 Dec 08 11:49:35.627346 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51e10952-ff09-4542-a8e5-181c97eeb2e3 req-c62ae42d-8fdc-45b8-880a-124717670861 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:35.628829 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-51e10952-ff09-4542-a8e5-181c97eeb2e3 req-c62ae42d-8fdc-45b8-880a-124717670861 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 944 time: 0.0510826 Dec 08 11:49:35.680683 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-51e10952-ff09-4542-a8e5-181c97eeb2e3 req-47759b94-5fb1-41b5-9f2a-244902557c58 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437827 Dec 08 11:49:35.884052 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:49:36.796042 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dd640f7-68c5-48f0-889c-cf88a6b2b3c8 req-fff4b92e-cb2b-46f3-8462-9680bb0eb339 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:36.797507 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7dd640f7-68c5-48f0-889c-cf88a6b2b3c8 req-fff4b92e-cb2b-46f3-8462-9680bb0eb339 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 944 time: 0.0482619 Dec 08 11:49:36.844786 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-7dd640f7-68c5-48f0-889c-cf88a6b2b3c8 req-10a9d5a9-b1bb-486f-8521-76cc3e1a96ae tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414042 Dec 08 11:49:37.961546 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-350cdd3e-0278-4111-bf9e-b4083c0aa14b req-8422d57e-afa2-4f90-accf-c1d6e21a0983 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:37.963042 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-350cdd3e-0278-4111-bf9e-b4083c0aa14b req-8422d57e-afa2-4f90-accf-c1d6e21a0983 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 944 time: 0.0505385 Dec 08 11:49:38.019578 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-350cdd3e-0278-4111-bf9e-b4083c0aa14b req-1f63fe21-6916-47be-a852-358aa2ea40b7 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0502059 Dec 08 11:49:38.749022 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device b00da941-b960-42cc-9123-d755131a0179 details requested by agent hyperv_hv-cinder-81977 with host hv-cinder-81977 {{(pid=102319) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 08 11:49:38.842439 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port b00da941-b960-42cc-9123-d755131a0179, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=b00da941-b960-42cc-9123-d755131a0179,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:49:38.853257 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Returning: {'device': 'b00da941-b960-42cc-9123-d755131a0179', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'port_id': 'b00da941-b960-42cc-9123-d755131a0179', 'mac_address': 'fa:16:3e:8a:30:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 258, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102319) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 08 11:49:38.889327 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:38.901906 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b00da941-b960-42cc-9123-d755131a0179 {{(pid=102319) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 08 11:49:38.920382 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port b00da941-b960-42cc-9123-d755131a0179, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=b00da941-b960-42cc-9123-d755131a0179,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:49:38.924521 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:38.971050 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=b00da941-b960-42cc-9123-d755131a0179,revision_number=4']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:49:38.977796 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:38.978143 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:38.978482 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:38.978815 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:38.979149 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:38.979468 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:38.979789 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:38.980109 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:38.980427 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:38.980747 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:38.981066 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:38.981410 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:38.981724 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102319) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:49:39.130890 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0c6330-1d1f-47be-b6e4-36bd9c447f03 req-f4df746f-80e0-4a40-9b12-ce83f43631e4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:39.132337 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2c0c6330-1d1f-47be-b6e4-36bd9c447f03 req-f4df746f-80e0-4a40-9b12-ce83f43631e4 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 945 time: 0.0479977 Dec 08 11:49:39.180821 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-2c0c6330-1d1f-47be-b6e4-36bd9c447f03 req-b09a366d-93a6-474a-b092-3f9d536b171e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422726 Dec 08 11:49:39.287249 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] get_ports_and_sgs() called for port_ids ['b00da941-b960-42cc-9123-d755131a0179'] {{(pid=102319) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 08 11:49:40.293841 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02cf160f-01e2-492b-a9ae-c817afc24bef req-252c8ee1-ba32-499f-bc92-2f898702711e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:40.295284 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-02cf160f-01e2-492b-a9ae-c817afc24bef req-252c8ee1-ba32-499f-bc92-2f898702711e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 945 time: 0.0476906 Dec 08 11:49:40.348873 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-02cf160f-01e2-492b-a9ae-c817afc24bef req-fb340de1-6efb-4305-be9a-321305ca226a tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477843 Dec 08 11:49:40.753937 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device b00da941-b960-42cc-9123-d755131a0179 up at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 08 11:49:40.803333 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning for port b00da941-b960-42cc-9123-d755131a0179 completed by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 08 11:49:40.807302 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.provisioning_blocks [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Provisioning complete for port b00da941-b960-42cc-9123-d755131a0179 triggered by entity L2. {{(pid=102319) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 08 11:49:40.807675 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-585418'] for port, provisioning_complete {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:40.881172 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:40.903065 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b00da941-b960-42cc-9123-d755131a0179'}] {{(pid=102319) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:49:40.905347 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f71777fcd24e87782c72e6e5cf31c1dd467e5080fe7470ae7960c472db38e36b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f8e93538-f031-4062-bf14-9b7ca029243e" -d '{"events": [{"server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "name": "network-vif-plugged", "status": "completed", "tag": "b00da941-b960-42cc-9123-d755131a0179"}]}' {{(pid=102319) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:49:40.921312 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.db [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] For port b00da941-b960-42cc-9123-d755131a0179, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=b00da941-b960-42cc-9123-d755131a0179,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102319) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:49:40.925917 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764'] for port, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:40.973837 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Pushing event updated for resources: {'Port': ['ID=b00da941-b960-42cc-9123-d755131a0179,revision_number=5']} {{(pid=102319) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:49:41.461100 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-370138ae-678b-4747-bff2-3b0b35857b15 req-5550c983-f957-472f-adc1-177f4c10036b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:41.462575 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-370138ae-678b-4747-bff2-3b0b35857b15 req-5550c983-f957-472f-adc1-177f4c10036b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 946 time: 0.0483334 Dec 08 11:49:41.510365 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-370138ae-678b-4747-bff2-3b0b35857b15 req-5fffc4a0-b498-416a-8018-365aef8433bb tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414011 Dec 08 11:49:41.964322 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:49:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f1a28336-4106-46ad-a1ec-15107d44c469 x-openstack-request-id: req-f1a28336-4106-46ad-a1ec-15107d44c469 {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:49:41.964792 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "name": "network-vif-plugged", "status": "completed", "tag": "b00da941-b960-42cc-9123-d755131a0179", "code": 200}]} {{(pid=102319) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:49:41.964895 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-f1a28336-4106-46ad-a1ec-15107d44c469 {{(pid=102319) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:49:41.965276 dv-cinder-819778-3-iscsi neutron-server[102319]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b00da941-b960-42cc-9123-d755131a0179', 'code': 200} Dec 08 11:49:42.172014 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbb4073a-e6f7-4849-b660-a23ace3039e3 req-1e32f047-e04f-4538-a840-6162e5410c5b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:42.173480 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bbb4073a-e6f7-4849-b660-a23ace3039e3 req-1e32f047-e04f-4538-a840-6162e5410c5b service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 1099 time: 0.0386968 Dec 08 11:49:42.218620 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bbb4073a-e6f7-4849-b660-a23ace3039e3 req-109a4c7f-974f-4e86-80e4-cc3632bf9431 service neutron] 10.222.0.61 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381031 Dec 08 11:49:42.623976 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3322825-878e-428b-babe-6bae2fc597ad req-6bcbc767-8a64-4240-a10f-f834a5cd50d5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:42.625514 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d3322825-878e-428b-babe-6bae2fc597ad req-6bcbc767-8a64-4240-a10f-f834a5cd50d5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 946 time: 0.0504985 Dec 08 11:49:42.673698 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d3322825-878e-428b-babe-6bae2fc597ad req-2954c6a0-6d6d-400b-a43d-3a7fa5f020e5 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424356 Dec 08 11:49:43.786701 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcf05b25-07a2-4d1e-bebb-f728e0d612b0 req-36a78043-8772-4397-935e-f3fcb319715b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:43.788118 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fcf05b25-07a2-4d1e-bebb-f728e0d612b0 req-36a78043-8772-4397-935e-f3fcb319715b tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 946 time: 0.0476763 Dec 08 11:49:43.836129 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-fcf05b25-07a2-4d1e-bebb-f728e0d612b0 req-ee1b3229-1ba5-4f4a-8b7e-48d9e16b43b3 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421915 Dec 08 11:49:43.948596 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d584b4da-0df8-46db-a181-c28a9156863a req-ca59edd5-710e-4910-bb50-9d8d9ee3b45d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:43.950049 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d584b4da-0df8-46db-a181-c28a9156863a req-ca59edd5-710e-4910-bb50-9d8d9ee3b45d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 946 time: 0.0497267 Dec 08 11:49:44.000060 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-d584b4da-0df8-46db-a181-c28a9156863a req-4c505a12-b961-4c92-a3fb-54525656da9d tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438948 Dec 08 11:49:44.021585 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33376) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:49:44.100528 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7a097b8-45ac-45e7-a5a3-753eb72929c2 tempest-TestVolumeBootPattern-1413654375 tempest-TestVolumeBootPattern-1413654375-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:44.102082 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-d7a097b8-45ac-45e7-a5a3-753eb72929c2 tempest-TestVolumeBootPattern-1413654375 tempest-TestVolumeBootPattern-1413654375-project-admin] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 1094 time: 0.0794690 Dec 08 11:49:44.104889 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33380) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:49:44.109047 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.v2.base [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Request body: {'floatingip': {'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'port_id': 'b00da941-b960-42cc-9123-d755131a0179', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address': '172.20.0.11'}} {{(pid=102318) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 08 11:49:44.129797 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for floatingip, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:44.225455 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:44.323413 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_common [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Allocated IP 172.27.2.74 (d7cb3021-649a-44ca-b3a1-005b3941164e/d3c85f21-b354-4935-be9d-64f27cdb4486/e8cdf596-8e1b-428c-91f5-2a2915d2e9f8) {{(pid=102318) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 08 11:49:44.423921 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for port, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:44.456044 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8729986444728', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:44.494353 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Network d7cb3021-649a-44ca-b3a1-005b3941164e is already hosted by enough agents. {{(pid=102318) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 08 11:49:44.499915 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.base_scheduler [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Resources bound (agent type, host, resource id): {{(pid=102318) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 08 11:49:44.502464 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Received port after_create {{(pid=102318) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 08 11:49:44.525079 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'Port': ['ID=e8cdf596-8e1b-428c-91f5-2a2915d2e9f8,revision_number=1']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:49:45.114487 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:45.177229 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-658414'] for port, before_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:45.321330 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for port, precommit_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:45.325602 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8729986960842', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8729986444746', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8729986444764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-4575738'] for port, after_update {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:45.399240 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event updated for resources: {'Port': ['ID=e8cdf596-8e1b-428c-91f5-2a2915d2e9f8,revision_number=2']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:49:45.407085 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-7898803'] for floatingip, after_create {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:45.502175 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Floating IP 72ed55c3-cfb5-4aa3-b2a1-0d5cddb058b4 associated. External IP: 172.27.2.74, port: b00da941-b960-42cc-9123-d755131a0179. Dec 08 11:49:45.704005 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Router 234433de-4188-442f-b5ef-12253c2924c3 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:49:45.808571 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:49:45.818420 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19a7a447-65ef-40ba-81ef-53e78a15f061 None None] Sync routers for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:49:45.827466 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:45.829293 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19a7a447-65ef-40ba-81ef-53e78a15f061 None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:49:45.830084 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-19a7a447-65ef-40ba-81ef-53e78a15f061 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:49:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:49:45.854093 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-11074025-35ff-4399-8cba-66515a9d9c36 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.7481730 Dec 08 11:49:45.854968 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'tag': 'b00da941-b960-42cc-9123-d755131a0179'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:49:45.857536 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1b23bc00-08d0-4770-a301-f94769ca82d7" -d '{"events": [{"name": "network-changed", "server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "tag": "b00da941-b960-42cc-9123-d755131a0179"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:49:45.895091 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:49:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e39cd0c2-40ac-4e1c-a81d-ea7d67118acc x-openstack-request-id: req-e39cd0c2-40ac-4e1c-a81d-ea7d67118acc {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:49:45.895385 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "tag": "b00da941-b960-42cc-9123-d755131a0179", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:49:45.895645 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-e39cd0c2-40ac-4e1c-a81d-ea7d67118acc {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:49:45.896047 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'tag': 'b00da941-b960-42cc-9123-d755131a0179', 'status': 'completed', 'code': 200} Dec 08 11:49:45.936362 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-19a7a447-65ef-40ba-81ef-53e78a15f061 None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:49:45.959178 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-8a22eeac-5920-4eff-aa8c-6e78d6846426 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:45.960598 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-8a22eeac-5920-4eff-aa8c-6e78d6846426 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 1099 time: 0.0432522 Dec 08 11:49:46.052319 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-7c805a51-5d76-473e-998b-c51dcf7c3329 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:46.053833 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-7c805a51-5d76-473e-998b-c51dcf7c3329 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.0848529 Dec 08 11:49:46.125359 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-8e58006e-73b2-484c-9ba2-952fd2f44f11 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b00da941-b960-42cc-9123-d755131a0179 HTTP/1.1" status: 200 len: 999 time: 0.0630651 Dec 08 11:49:46.173605 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-89ef2aaa-c302-44d0-8812-17a56e8c57e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:46.175056 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-89ef2aaa-c302-44d0-8812-17a56e8c57e7 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0432482 Dec 08 11:49:46.220563 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-7e5af020-78af-430e-a94d-9912bb5a4b3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:49:46.221992 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-7e5af020-78af-430e-a94d-9912bb5a4b3f service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0399408 Dec 08 11:49:46.289282 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-19a7a447-65ef-40ba-81ef-53e78a15f061 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': '72ed55c3-cfb5-4aa3-b2a1-0d5cddb058b4', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.74', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': 'b00da941-b960-42cc-9123-d755131a0179', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:8a:30:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:49:44Z', 'updated_at': '2021-12-08T11:49:44Z', 'revision_number': 0, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}, {'id': 'e2b870c9-385e-489a-bcd5-ac3e393ed053', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.25', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': '5c746524-978d-4ccf-9310-1c436d0934a6', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:1f:45:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:47:18Z', 'updated_at': '2021-12-08T11:47:20Z', 'revision_number': 1, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:49:46.315974 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19a7a447-65ef-40ba-81ef-53e78a15f061 None None] Checking router: 234433de-4188-442f-b5ef-12253c2924c3 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:49:46.318420 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-fa16a70f-a052-4785-b134-4488adc64395 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0891726 Dec 08 11:49:46.324331 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19a7a447-65ef-40ba-81ef-53e78a15f061 None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:49:46.324934 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-19a7a447-65ef-40ba-81ef-53e78a15f061 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:49:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:49:46.406614 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1b23bc00-08d0-4770-a301-f94769ca82d7 req-b7b47533-ae34-4871-924a-5ad7835496a8 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814354 Dec 08 11:49:46.431845 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-19a7a447-65ef-40ba-81ef-53e78a15f061 None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:49:46.651722 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-19a7a447-65ef-40ba-81ef-53e78a15f061 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': '72ed55c3-cfb5-4aa3-b2a1-0d5cddb058b4', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.74', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': 'b00da941-b960-42cc-9123-d755131a0179', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:8a:30:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:49:44Z', 'updated_at': '2021-12-08T11:49:44Z', 'revision_number': 0, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}, {'id': 'e2b870c9-385e-489a-bcd5-ac3e393ed053', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.25', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': '5c746524-978d-4ccf-9310-1c436d0934a6', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:1f:45:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:47:18Z', 'updated_at': '2021-12-08T11:47:20Z', 'revision_number': 1, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:49:46.678039 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19a7a447-65ef-40ba-81ef-53e78a15f061 None None] The sync data for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi is: [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': '72ed55c3-cfb5-4aa3-b2a1-0d5cddb058b4', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.74', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': 'b00da941-b960-42cc-9123-d755131a0179', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:8a:30:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:49:44Z', 'updated_at': '2021-12-08T11:49:44Z', 'revision_number': 0, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}, {'id': 'e2b870c9-385e-489a-bcd5-ac3e393ed053', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.25', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': '5c746524-978d-4ccf-9310-1c436d0934a6', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:1f:45:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:47:18Z', 'updated_at': '2021-12-08T11:47:20Z', 'revision_number': 1, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:49:46.852489 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc75c8a2-49ed-43f1-be1d-182a6f7b2bba None None] New status for floating IP 72ed55c3-cfb5-4aa3-b2a1-0d5cddb058b4: ACTIVE {{(pid=102320) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:49:47.758125 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:52.506499 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-da5faabd-8a81-4c6e-826d-819de1245347 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:54.738615 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-3e35af94-df46-4fb4-bad3-937f66f0c0b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:55.855365 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:57.205167 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:49:58.199728 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:50:12.883105 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:50:17.742870 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:50:22.508332 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-810a0a2d-8788-4c7e-9771-d58a940ef89e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:50:24.740027 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-278215d0-6d6d-436e-bc33-248179450177 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:50:25.855056 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:50:26.636408 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d4fbeb4-d1af-448a-8c73-8318998cbd95 req-e019d0e3-fe2b-4f0c-a294-3c899141a4d8 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0389166 Dec 08 11:50:26.719634 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4fbeb4-d1af-448a-8c73-8318998cbd95 req-04ea895f-0ae3-4331-96e3-79f6856338ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:50:26.721107 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d4fbeb4-d1af-448a-8c73-8318998cbd95 req-04ea895f-0ae3-4331-96e3-79f6856338ff service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 1098 time: 0.0436397 Dec 08 11:50:26.826132 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4fbeb4-d1af-448a-8c73-8318998cbd95 req-4b34b935-7bd9-4508-8ae1-1afbbe865453 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:50:26.827588 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d4fbeb4-d1af-448a-8c73-8318998cbd95 req-4b34b935-7bd9-4508-8ae1-1afbbe865453 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.0883636 Dec 08 11:50:26.894751 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d4fbeb4-d1af-448a-8c73-8318998cbd95 req-48d2c39a-ece2-48d0-9af7-b3fa798bb358 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5c746524-978d-4ccf-9310-1c436d0934a6 HTTP/1.1" status: 200 len: 1000 time: 0.0603175 Dec 08 11:50:26.944242 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4fbeb4-d1af-448a-8c73-8318998cbd95 req-131d6907-55d8-4059-937b-baa66cbcc334 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:50:26.945663 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d4fbeb4-d1af-448a-8c73-8318998cbd95 req-131d6907-55d8-4059-937b-baa66cbcc334 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0427911 Dec 08 11:50:26.989505 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4fbeb4-d1af-448a-8c73-8318998cbd95 req-058f8a3b-a65d-4f6e-bb5d-7d433b7ec18a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:50:26.990942 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d4fbeb4-d1af-448a-8c73-8318998cbd95 req-058f8a3b-a65d-4f6e-bb5d-7d433b7ec18a service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0387993 Dec 08 11:50:27.082783 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d4fbeb4-d1af-448a-8c73-8318998cbd95 req-12e93c23-c4ce-45b6-818c-5370cae03711 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842023 Dec 08 11:50:27.174748 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-5d4fbeb4-d1af-448a-8c73-8318998cbd95 req-fcab8986-bc96-462e-811f-43d15ec10d76 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839744 Dec 08 11:50:27.206597 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:50:28.201778 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:50:47.772970 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:50:49.880912 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:50:52.509507 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-96f8d9fd-948f-47a9-9dd2-3500ff4177c6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:50:54.741572 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-744104d0-97a1-42b1-a0d2-93226c3aed64 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:50:55.858032 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:50:57.210538 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:50:58.203594 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:17.787303 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:22.509426 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-5045112a-b463-4a35-a3ed-d5c39f4e97aa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:24.745188 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-76bb6b06-5770-4e29-a555-e6b93968b889 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:25.860746 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:26.639808 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b8a7995d-9755-4220-a632-307cd714c38f req-05ca0e75-4054-4ff8-9cc5-a5e537f4bacf service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0391603 Dec 08 11:51:26.704049 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a7995d-9755-4220-a632-307cd714c38f req-9424889f-e470-4f40-b6c2-875b03bcefbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:26.705529 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b8a7995d-9755-4220-a632-307cd714c38f req-9424889f-e470-4f40-b6c2-875b03bcefbf service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 1099 time: 0.0437758 Dec 08 11:51:26.807059 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a7995d-9755-4220-a632-307cd714c38f req-03268fc3-bab2-4f10-aa02-56d9e439ca52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:26.808489 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b8a7995d-9755-4220-a632-307cd714c38f req-03268fc3-bab2-4f10-aa02-56d9e439ca52 service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.0821333 Dec 08 11:51:26.878187 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b8a7995d-9755-4220-a632-307cd714c38f req-61904b47-025a-4626-8a6f-96d2ac021ad1 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b00da941-b960-42cc-9123-d755131a0179 HTTP/1.1" status: 200 len: 1001 time: 0.0619102 Dec 08 11:51:26.879389 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:51:26.926503 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a7995d-9755-4220-a632-307cd714c38f req-598f4035-d0c8-4d5f-8f8a-d6a1363280b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:26.927805 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b8a7995d-9755-4220-a632-307cd714c38f req-598f4035-d0c8-4d5f-8f8a-d6a1363280b2 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0429945 Dec 08 11:51:26.975188 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a7995d-9755-4220-a632-307cd714c38f req-07a31212-c129-4fb2-9d2a-8c65c17e727c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:26.976665 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b8a7995d-9755-4220-a632-307cd714c38f req-07a31212-c129-4fb2-9d2a-8c65c17e727c service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0420403 Dec 08 11:51:27.067491 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b8a7995d-9755-4220-a632-307cd714c38f req-551e7233-4fac-4640-a6b8-bc4255367a94 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0836926 Dec 08 11:51:27.155784 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-b8a7995d-9755-4220-a632-307cd714c38f req-b277360d-5c54-4644-aff8-bcce3d66b43f service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812809 Dec 08 11:51:27.214362 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:28.206383 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:40.543644 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [req-e3e0669b-c6a1-4aed-b231-6a75ab746b05 req-546e167b-b140-43ed-92d5-fa098575c759 service neutron] (102318) timed out ('10.222.0.61', 56747) {{(pid=102318) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 08 11:51:47.786951 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:48.532337 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33418) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:51:48.687145 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Deleting port e8cdf596-8e1b-428c-91f5-2a2915d2e9f8 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:51:48.687479 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:48.762470 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:48.762790 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:48.773941 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling delete_port for e8cdf596-8e1b-428c-91f5-2a2915d2e9f8 owned by network:floatingip {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:51:48.917428 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:48.942899 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event deleted for resources: {'Port': ['ID=e8cdf596-8e1b-428c-91f5-2a2915d2e9f8,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:51:48.966744 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:51:48.967096 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:51:48.967440 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:51:48.967776 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:51:48.968107 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:51:48.968434 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:51:48.968761 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:51:48.969086 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:51:48.969434 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:51:48.970347 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:51:48.970673 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:51:48.970994 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:51:48.971311 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102318) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:51:49.010924 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for floatingip, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:49.011247 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Floating IP 72ed55c3-cfb5-4aa3-b2a1-0d5cddb058b4 disassociated (deleted). External IP: 172.27.2.74, port: b00da941-b960-42cc-9123-d755131a0179. Dec 08 11:51:49.212548 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Router 234433de-4188-442f-b5ef-12253c2924c3 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:51:49.317103 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:51:49.321864 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:49.326896 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af4ac4c1-415e-4a69-929c-f2f6668669be None None] Sync routers for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:51:49.335807 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af4ac4c1-415e-4a69-929c-f2f6668669be None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:51:49.336411 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-af4ac4c1-415e-4a69-929c-f2f6668669be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:51:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:51:49.347495 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-445ba7fd-e3ec-4c33-ae24-0775c989d896 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "DELETE /v2.0/floatingips/72ed55c3-cfb5-4aa3-b2a1-0d5cddb058b4 HTTP/1.1" status: 204 len: 168 time: 0.8141792 Dec 08 11:51:49.348184 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'tag': 'b00da941-b960-42cc-9123-d755131a0179'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:51:49.350566 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a" -d '{"events": [{"name": "network-changed", "server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "tag": "b00da941-b960-42cc-9123-d755131a0179"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:51:49.393259 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:51:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-02b57148-5ac7-402e-be59-c6e9442635be x-openstack-request-id: req-02b57148-5ac7-402e-be59-c6e9442635be {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:51:49.393563 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "tag": "b00da941-b960-42cc-9123-d755131a0179", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:51:49.394265 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-02b57148-5ac7-402e-be59-c6e9442635be {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:51:49.394678 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'tag': 'b00da941-b960-42cc-9123-d755131a0179', 'status': 'completed', 'code': 200} Dec 08 11:51:49.442232 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-af4ac4c1-415e-4a69-929c-f2f6668669be None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:51:49.459474 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-e4bf6dd2-acf7-46b8-9621-5ab554b4442e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:49.460985 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-e4bf6dd2-acf7-46b8-9621-5ab554b4442e service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 1099 time: 0.0433462 Dec 08 11:51:49.592324 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-a7cd795d-25ea-41e3-a14c-7e56976056ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:49.593846 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-a7cd795d-25ea-41e3-a14c-7e56976056ba service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.1216459 Dec 08 11:51:49.606125 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33a11f91-3c7f-4a33-b27a-a482523a75da req-b2c7f3d1-6887-4d3f-9b23-a9d043c57541 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:49.607533 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33a11f91-3c7f-4a33-b27a-a482523a75da req-b2c7f3d1-6887-4d3f-9b23-a9d043c57541 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 946 time: 0.0700142 Dec 08 11:51:49.651646 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-8fa29f05-6766-45e9-87fa-b45b0258781b service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=b00da941-b960-42cc-9123-d755131a0179 HTTP/1.1" status: 200 len: 217 time: 0.0431771 Dec 08 11:51:49.673035 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-af4ac4c1-415e-4a69-929c-f2f6668669be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'e2b870c9-385e-489a-bcd5-ac3e393ed053', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.25', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': '5c746524-978d-4ccf-9310-1c436d0934a6', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:1f:45:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:47:18Z', 'updated_at': '2021-12-08T11:47:20Z', 'revision_number': 1, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:51:49.699302 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af4ac4c1-415e-4a69-929c-f2f6668669be None None] Checking router: 234433de-4188-442f-b5ef-12253c2924c3 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:51:49.708021 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af4ac4c1-415e-4a69-929c-f2f6668669be None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:51:49.708623 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-af4ac4c1-415e-4a69-929c-f2f6668669be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:51:25Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:51:49.721754 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33a11f91-3c7f-4a33-b27a-a482523a75da req-f7f93dbd-3c54-470e-aa6d-7448779b3da1 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1067481 Dec 08 11:51:49.725518 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-4a5b0ef1-887e-4caa-97cf-7c80ac8300ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:49.726879 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-4a5b0ef1-887e-4caa-97cf-7c80ac8300ba service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0669358 Dec 08 11:51:49.774172 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-40d169da-35da-4520-865f-c28bf759419a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:49.775715 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-40d169da-35da-4520-865f-c28bf759419a service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0405002 Dec 08 11:51:49.812352 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-af4ac4c1-415e-4a69-929c-f2f6668669be None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:51:49.866579 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-47b51535-ec6c-437a-9cc0-6e69ed787896 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834010 Dec 08 11:51:49.958163 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-33bc5f3d-ee21-439a-a2ca-33ab95d2f66a req-d035b8c8-90d3-4587-bebc-1c1230a9ff8a service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832596 Dec 08 11:51:50.034759 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-af4ac4c1-415e-4a69-929c-f2f6668669be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'e2b870c9-385e-489a-bcd5-ac3e393ed053', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.25', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': '5c746524-978d-4ccf-9310-1c436d0934a6', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:1f:45:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:47:18Z', 'updated_at': '2021-12-08T11:47:20Z', 'revision_number': 1, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:51:50.063258 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af4ac4c1-415e-4a69-929c-f2f6668669be None None] The sync data for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi is: [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_floatingips': [{'id': 'e2b870c9-385e-489a-bcd5-ac3e393ed053', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'floating_ip_address': '172.27.2.25', 'floating_network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'router_id': '234433de-4188-442f-b5ef-12253c2924c3', 'port_id': '5c746524-978d-4ccf-9310-1c436d0934a6', 'fixed_ip_address': '172.20.0.5', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'mac_address': 'fa:16:3e:1f:45:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-08T11:47:18Z', 'updated_at': '2021-12-08T11:47:20Z', 'revision_number': 1, 'project_id': '8cd51b040b7242d084a290de749786b8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:51:50.265536 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d706434f-61db-47b7-a951-3f9c7e462f90 None None] New status for floating IP 72ed55c3-cfb5-4aa3-b2a1-0d5cddb058b4: DOWN {{(pid=102320) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:51:50.842989 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1fdd0e-2fed-44c1-b14f-f39ddadd69d1 req-6c707a90-f526-466d-9d5d-88b5052e771e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:50.844442 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-da1fdd0e-2fed-44c1-b14f-f39ddadd69d1 req-6c707a90-f526-466d-9d5d-88b5052e771e tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 946 time: 0.0537858 Dec 08 11:51:50.893354 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-da1fdd0e-2fed-44c1-b14f-f39ddadd69d1 req-b1b723f2-5e5d-40b1-83dc-af9031a06b03 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423660 Dec 08 11:51:51.318354 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-390c168c-cb29-4ed2-8b28-92e0e4abb667 req-46ef950f-3729-4a86-b8c5-fddc2ff573be tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:51.319803 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-390c168c-cb29-4ed2-8b28-92e0e4abb667 req-46ef950f-3729-4a86-b8c5-fddc2ff573be tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 946 time: 0.0466115 Dec 08 11:51:51.406441 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-390c168c-cb29-4ed2-8b28-92e0e4abb667 req-9fc55524-c806-42ed-ad39-f8fdc7b93727 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Deleting port b00da941-b960-42cc-9123-d755131a0179 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:51:51.406695 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-390c168c-cb29-4ed2-8b28-92e0e4abb667 req-9fc55524-c806-42ed-ad39-f8fdc7b93727 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:51.494811 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-390c168c-cb29-4ed2-8b28-92e0e4abb667 req-9fc55524-c806-42ed-ad39-f8fdc7b93727 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] For port b00da941-b960-42cc-9123-d755131a0179, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=b00da941-b960-42cc-9123-d755131a0179,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:51:51.495174 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-390c168c-cb29-4ed2-8b28-92e0e4abb667 req-9fc55524-c806-42ed-ad39-f8fdc7b93727 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:51.507944 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-390c168c-cb29-4ed2-8b28-92e0e4abb667 req-9fc55524-c806-42ed-ad39-f8fdc7b93727 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling delete_port for b00da941-b960-42cc-9123-d755131a0179 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:51:51.632344 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-390c168c-cb29-4ed2-8b28-92e0e4abb667 req-9fc55524-c806-42ed-ad39-f8fdc7b93727 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:51.659572 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc55524-c806-42ed-ad39-f8fdc7b93727 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event deleted for resources: {'Port': ['ID=b00da941-b960-42cc-9123-d755131a0179,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:51:51.699236 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-390c168c-cb29-4ed2-8b28-92e0e4abb667 req-9fc55524-c806-42ed-ad39-f8fdc7b93727 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] No DVR routers for this DVR port b00da941-b960-42cc-9123-d755131a0179 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:51:51.701731 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-390c168c-cb29-4ed2-8b28-92e0e4abb667 req-9fc55524-c806-42ed-ad39-f8fdc7b93727 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:51.705018 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-390c168c-cb29-4ed2-8b28-92e0e4abb667 req-9fc55524-c806-42ed-ad39-f8fdc7b93727 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "DELETE /v2.0/ports/b00da941-b960-42cc-9123-d755131a0179 HTTP/1.1" status: 204 len: 173 time: 0.3787630 Dec 08 11:51:51.705476 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'name': 'network-vif-deleted', 'tag': 'b00da941-b960-42cc-9123-d755131a0179'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:51:51.707793 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d170a51a-d59e-4153-a1c0-ca1f0b80469d" -d '{"events": [{"server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "name": "network-vif-deleted", "tag": "b00da941-b960-42cc-9123-d755131a0179"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:51:51.768473 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:51:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ac08585-ecae-4af4-ad4a-db4f8a3f7346 x-openstack-request-id: req-8ac08585-ecae-4af4-ad4a-db4f8a3f7346 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:51:51.768769 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "41844874-f1c6-4195-85ed-49cb1f149ae8", "name": "network-vif-deleted", "tag": "b00da941-b960-42cc-9123-d755131a0179", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:51:51.769022 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-8ac08585-ecae-4af4-ad4a-db4f8a3f7346 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:51:51.770416 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '41844874-f1c6-4195-85ed-49cb1f149ae8', 'name': 'network-vif-deleted', 'tag': 'b00da941-b960-42cc-9123-d755131a0179', 'status': 'completed', 'code': 200} Dec 08 11:51:51.990634 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-eea31696-1bd9-4507-8047-0f4bc570a552 req-5676edd1-4b0f-4862-833d-ae823c74b517 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=41844874-f1c6-4195-85ed-49cb1f149ae8 HTTP/1.1" status: 200 len: 210 time: 0.0317643 Dec 08 11:51:52.510074 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-ae2ce3c5-959a-4f69-9edb-e92519dd4a97 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:54.745587 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a445687a-f20b-487e-966e-fad48ccade81 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:55.256617 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33458) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:51:55.410698 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-73c1573d-45a0-47d1-a561-18b377dd6ce9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Deleting port 8c769dc5-d667-4eab-bee2-a8c1ebaf3735 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:51:55.410934 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-73c1573d-45a0-47d1-a561-18b377dd6ce9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:55.415202 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device b00da941-b960-42cc-9123-d755131a0179 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:51:55.434540 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: b00da941-b960-42cc-9123-d755131a0179 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:51:55.434879 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device b00da941-b960-42cc-9123-d755131a0179 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:51:55.482801 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-73c1573d-45a0-47d1-a561-18b377dd6ce9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:55.483121 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-73c1573d-45a0-47d1-a561-18b377dd6ce9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:55.494389 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-73c1573d-45a0-47d1-a561-18b377dd6ce9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling delete_port for 8c769dc5-d667-4eab-bee2-a8c1ebaf3735 owned by network:floatingip {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:51:55.639172 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-73c1573d-45a0-47d1-a561-18b377dd6ce9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:55.669085 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73c1573d-45a0-47d1-a561-18b377dd6ce9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event deleted for resources: {'Port': ['ID=8c769dc5-d667-4eab-bee2-a8c1ebaf3735,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:51:55.864883 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:56.009269 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-73c1573d-45a0-47d1-a561-18b377dd6ce9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for floatingip, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:56.009530 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.db.l3_db [None req-73c1573d-45a0-47d1-a561-18b377dd6ce9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Floating IP e2b870c9-385e-489a-bcd5-ac3e393ed053 disassociated (deleted). External IP: 172.27.2.25, port: 5c746524-978d-4ccf-9310-1c436d0934a6. Dec 08 11:51:56.212125 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-73c1573d-45a0-47d1-a561-18b377dd6ce9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Router 234433de-4188-442f-b5ef-12253c2924c3 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102318) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:51:56.317535 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-73c1573d-45a0-47d1-a561-18b377dd6ce9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102318) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:51:56.322134 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-73c1573d-45a0-47d1-a561-18b377dd6ce9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:56.331433 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f8808e2-7d0e-4fc3-aae2-49c4c3483fc9 None None] Sync routers for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:51:56.341028 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f8808e2-7d0e-4fc3-aae2-49c4c3483fc9 None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:51:56.342257 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-5f8808e2-7d0e-4fc3-aae2-49c4c3483fc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:51:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:51:56.350960 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-73c1573d-45a0-47d1-a561-18b377dd6ce9 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "DELETE /v2.0/floatingips/e2b870c9-385e-489a-bcd5-ac3e393ed053 HTTP/1.1" status: 204 len: 168 time: 1.0906899 Dec 08 11:51:56.350960 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'tag': '5c746524-978d-4ccf-9310-1c436d0934a6'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:51:56.351352 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f143c1d3-72e0-4dde-afc9-fb113daa3946" -d '{"events": [{"name": "network-changed", "server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:51:56.394386 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 08 Dec 2021 11:51:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-244426fb-cd55-4529-8b43-6f0c6307e444 x-openstack-request-id: req-244426fb-cd55-4529-8b43-6f0c6307e444 {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:51:56.394698 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:51:56.395053 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-244426fb-cd55-4529-8b43-6f0c6307e444 {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:51:56.395360 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'tag': '5c746524-978d-4ccf-9310-1c436d0934a6', 'status': 'completed', 'code': 200} Dec 08 11:51:56.454867 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-5f8808e2-7d0e-4fc3-aae2-49c4c3483fc9 None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:51:56.462478 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-00d1ad04-9039-4002-a4b6-4cdff08ef798 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:56.464000 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-00d1ad04-9039-4002-a4b6-4cdff08ef798 service neutron] 10.222.0.61 "GET /v2.0/ports?tenant_id=8cd51b040b7242d084a290de749786b8&device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 1098 time: 0.0451837 Dec 08 11:51:56.600768 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-f3af8ecf-f067-4902-9b8b-7a87c000a19f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:56.602301 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-f3af8ecf-f067-4902-9b8b-7a87c000a19f service neutron] 10.222.0.61 "GET /v2.0/networks?id=b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 200 len: 913 time: 0.1301889 Dec 08 11:51:56.613236 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d074853-9565-4760-973b-47412b1c1bb5 req-85f89673-f6d5-43aa-a518-124b8f593909 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:56.614545 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1d074853-9565-4760-973b-47412b1c1bb5 req-85f89673-f6d5-43aa-a518-124b8f593909 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 945 time: 0.0724833 Dec 08 11:51:56.659492 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-82c3a821-8271-47d0-a549-f040bb066298 service neutron] 10.222.0.61 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=5c746524-978d-4ccf-9310-1c436d0934a6 HTTP/1.1" status: 200 len: 217 time: 0.0439987 Dec 08 11:51:56.721215 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-1d074853-9565-4760-973b-47412b1c1bb5 req-ec15b0ea-ed69-4e1b-9c58-695675fab4e2 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1002018 Dec 08 11:51:56.733454 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-682ef903-d770-43f1-865b-897d44787e80 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:56.735437 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-682ef903-d770-43f1-865b-897d44787e80 service neutron] 10.222.0.61 "GET /v2.0/subnets?id=4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 200 len: 851 time: 0.0678298 Dec 08 11:51:56.781441 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-fb7cdd8e-d454-4652-8151-536f7dfa8c1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:56.782971 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-fb7cdd8e-d454-4652-8151-536f7dfa8c1f service neutron] 10.222.0.61 "GET /v2.0/ports?network_id=b6155a6c-7a89-4b5b-b3cb-d77c93560254&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0402212 Dec 08 11:51:56.794365 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-5f8808e2-7d0e-4fc3-aae2-49c4c3483fc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:51:56.820701 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f8808e2-7d0e-4fc3-aae2-49c4c3483fc9 None None] Checking router: 234433de-4188-442f-b5ef-12253c2924c3 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:51:56.828837 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f8808e2-7d0e-4fc3-aae2-49c4c3483fc9 None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:51:56.829470 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-5f8808e2-7d0e-4fc3-aae2-49c4c3483fc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:51:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:51:56.875106 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-a0dd2c7f-f193-42fe-a7cc-e3d31ced6285 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838325 Dec 08 11:51:56.933384 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-5f8808e2-7d0e-4fc3-aae2-49c4c3483fc9 None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:51:56.963416 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-f143c1d3-72e0-4dde-afc9-fb113daa3946 req-5b25f696-5204-4f9f-8cb3-7363390360d5 service neutron] 10.222.0.61 "GET /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0801432 Dec 08 11:51:57.133132 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-5f8808e2-7d0e-4fc3-aae2-49c4c3483fc9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:51:57.160245 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f8808e2-7d0e-4fc3-aae2-49c4c3483fc9 None None] The sync data for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi is: [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:56Z', 'revision_number': 4, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi', '_interfaces': [{'id': '7ab3f4bf-1191-4491-9b0f-e248b2de3a62', 'name': '', 'network_id': 'b6155a6c-7a89-4b5b-b3cb-d77c93560254', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'mac_address': 'fa:16:3e:65:2f:00', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:55Z', 'updated_at': '2021-12-08T11:44:01Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'subnets': [{'id': '4923b9ae-1dff-4272-9f7a-1921aac84705', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:51:57.215324 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:57.386236 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb6f31cd-9862-424a-ae61-3d3a59398a4c None None] New status for floating IP e2b870c9-385e-489a-bcd5-ac3e393ed053: DOWN {{(pid=102320) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 08 11:51:57.838045 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac1603b0-e5ea-4e52-8b68-f5e5b69ea57d req-10a2e257-8e02-48e4-9183-d1aaad817e91 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:57.839488 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ac1603b0-e5ea-4e52-8b68-f5e5b69ea57d req-10a2e257-8e02-48e4-9183-d1aaad817e91 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 945 time: 0.0482397 Dec 08 11:51:57.886160 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-ac1603b0-e5ea-4e52-8b68-f5e5b69ea57d req-063c5329-7f22-4136-b99b-10c4f8153448 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/security-groups?id=e47b7911-1842-43a5-a5fe-dedb91083734&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408585 Dec 08 11:51:58.208028 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:58.259085 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d0ca8ad-3315-419c-804a-217ef08d99c6 req-83be5e80-69b3-4a62-99ab-d9256bb7df86 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102318) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 08 11:51:58.260548 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9d0ca8ad-3315-419c-804a-217ef08d99c6 req-83be5e80-69b3-4a62-99ab-d9256bb7df86 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 945 time: 0.0513322 Dec 08 11:51:58.345643 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-9d0ca8ad-3315-419c-804a-217ef08d99c6 req-e2455738-e640-477a-adfb-1315f79909c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Deleting port 5c746524-978d-4ccf-9310-1c436d0934a6 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:51:58.345898 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-9d0ca8ad-3315-419c-804a-217ef08d99c6 req-e2455738-e640-477a-adfb-1315f79909c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:58.441343 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [req-9d0ca8ad-3315-419c-804a-217ef08d99c6 req-e2455738-e640-477a-adfb-1315f79909c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] For port 5c746524-978d-4ccf-9310-1c436d0934a6, host hv-cinder-81977, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81977',level=0,port_id=5c746524-978d-4ccf-9310-1c436d0934a6,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:51:58.441710 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-9d0ca8ad-3315-419c-804a-217ef08d99c6 req-e2455738-e640-477a-adfb-1315f79909c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:58.454642 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [req-9d0ca8ad-3315-419c-804a-217ef08d99c6 req-e2455738-e640-477a-adfb-1315f79909c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling delete_port for 5c746524-978d-4ccf-9310-1c436d0934a6 owned by compute:nova {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:51:58.580263 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-9d0ca8ad-3315-419c-804a-217ef08d99c6 req-e2455738-e640-477a-adfb-1315f79909c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:58.607370 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2455738-e640-477a-adfb-1315f79909c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event deleted for resources: {'Port': ['ID=5c746524-978d-4ccf-9310-1c436d0934a6,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:51:58.648522 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [req-9d0ca8ad-3315-419c-804a-217ef08d99c6 req-e2455738-e640-477a-adfb-1315f79909c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] No DVR routers for this DVR port 5c746524-978d-4ccf-9310-1c436d0934a6 on host hv-cinder-81977 {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:51:58.650871 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [req-9d0ca8ad-3315-419c-804a-217ef08d99c6 req-e2455738-e640-477a-adfb-1315f79909c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for port, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:51:58.654176 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-9d0ca8ad-3315-419c-804a-217ef08d99c6 req-e2455738-e640-477a-adfb-1315f79909c8 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.61 "DELETE /v2.0/ports/5c746524-978d-4ccf-9310-1c436d0934a6 HTTP/1.1" status: 204 len: 173 time: 0.3879573 Dec 08 11:51:58.654619 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'name': 'network-vif-deleted', 'tag': '5c746524-978d-4ccf-9310-1c436d0934a6'}] {{(pid=102318) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 08 11:51:58.656884 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.66/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0b11efb18dc1bfa7a0da544788f1616e1fc3088f3b7573c040c1bafc903112af" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-729f19ff-fb93-4cb4-b9b4-85c7291e8305" -d '{"events": [{"server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "name": "network-vif-deleted", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6"}]}' {{(pid=102318) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 08 11:51:58.695602 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 08 Dec 2021 11:51:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63b7aadc-ab69-4bc7-8a8d-fb8d1a90469e x-openstack-request-id: req-63b7aadc-ab69-4bc7-8a8d-fb8d1a90469e {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 08 11:51:58.695901 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "11f57812-dea3-4a2d-9c1e-8b827a2c5be3", "name": "network-vif-deleted", "tag": "5c746524-978d-4ccf-9310-1c436d0934a6", "status": "completed", "code": 200}]} {{(pid=102318) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 08 11:51:58.696154 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.66/compute/v2.1/os-server-external-events used request id req-63b7aadc-ab69-4bc7-8a8d-fb8d1a90469e {{(pid=102318) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 08 11:51:58.696549 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '11f57812-dea3-4a2d-9c1e-8b827a2c5be3', 'name': 'network-vif-deleted', 'tag': '5c746524-978d-4ccf-9310-1c436d0934a6', 'status': 'completed', 'code': 200} Dec 08 11:51:58.997455 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [req-bc6e7377-7b13-4231-a028-88751719a461 req-3eae22d5-2109-4687-ad2a-a34d18933a34 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "GET /v2.0/ports?device_id=11f57812-dea3-4a2d-9c1e-8b827a2c5be3 HTTP/1.1" status: 200 len: 210 time: 0.0266211 Dec 08 11:52:00.053683 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33474) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:00.177597 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-6f8fccc0-e5e9-4d35-8a1b-c0fb44389d1c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Deleting port 66086c64-e361-427a-a641-83b7c2b6acab {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:52:00.177934 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6f8fccc0-e5e9-4d35-8a1b-c0fb44389d1c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:00.252542 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6f8fccc0-e5e9-4d35-8a1b-c0fb44389d1c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:00.253251 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6f8fccc0-e5e9-4d35-8a1b-c0fb44389d1c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:00.264716 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-6f8fccc0-e5e9-4d35-8a1b-c0fb44389d1c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Calling delete_port for 66086c64-e361-427a-a641-83b7c2b6acab owned by network:floatingip {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:52:00.392445 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6f8fccc0-e5e9-4d35-8a1b-c0fb44389d1c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:00.417109 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f8fccc0-e5e9-4d35-8a1b-c0fb44389d1c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event deleted for resources: {'Port': ['ID=66086c64-e361-427a-a641-83b7c2b6acab,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:00.478241 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6f8fccc0-e5e9-4d35-8a1b-c0fb44389d1c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for floatingip, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:00.480822 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6f8fccc0-e5e9-4d35-8a1b-c0fb44389d1c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-17065'] for floatingip, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:00.482014 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-6f8fccc0-e5e9-4d35-8a1b-c0fb44389d1c tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "DELETE /v2.0/floatingips/0b33a32f-8f06-476d-999e-294727587a32 HTTP/1.1" status: 204 len: 168 time: 0.4273434 Dec 08 11:52:01.462477 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 5c746524-978d-4ccf-9310-1c436d0934a6 no longer exists at agent hyperv_hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:52:01.482534 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] No Port match for: 5c746524-978d-4ccf-9310-1c436d0934a6 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:52:01.482872 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Device 5c746524-978d-4ccf-9310-1c436d0934a6 not bound to the agent host hv-cinder-81977 {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:52:01.662794 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33486) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:01.716917 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6034a84a-32da-4d8b-b6c4-997c73501495 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:01.740358 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6034a84a-32da-4d8b-b6c4-997c73501495 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:01.801913 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6034a84a-32da-4d8b-b6c4-997c73501495 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:01.804538 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-6034a84a-32da-4d8b-b6c4-997c73501495 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:01.805724 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-6034a84a-32da-4d8b-b6c4-997c73501495 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] 10.222.0.66 "DELETE /v2.0/security-groups/e47b7911-1842-43a5-a5fe-dedb91083734 HTTP/1.1" status: 204 len: 168 time: 0.1419320 Dec 08 11:52:01.816556 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6034a84a-32da-4d8b-b6c4-997c73501495 tempest-TestVolumeBootPattern-840322656 tempest-TestVolumeBootPattern-840322656-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e47b7911-1842-43a5-a5fe-dedb91083734,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:01.864702 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 33490) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:02.334979 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7897011'] for router_interface, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:02.573426 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Deleting port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 {{(pid=102317) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:52:02.573765 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:02.649470 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] For port 7ab3f4bf-1191-4491-9b0f-e248b2de3a62, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=7ab3f4bf-1191-4491-9b0f-e248b2de3a62,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102317) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:52:02.649751 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:02.662594 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Calling delete_port for 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 owned by network:router_interface {{(pid=102317) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:52:02.839978 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:02.867478 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Pushing event deleted for resources: {'Port': ['ID=7ab3f4bf-1191-4491-9b0f-e248b2de3a62,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:02.894535 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:52:02.894891 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:52:02.895238 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:52:02.895580 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:52:02.895915 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:52:02.896253 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:52:02.896581 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:52:02.896911 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:52:02.897264 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:52:02.897595 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:52:02.897921 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:52:02.898244 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:52:02.898570 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819778-3-iscsi {{(pid=102317) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 08 11:52:03.040246 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8074906', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7896871'] for router_interface, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:03.246769 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Router 234433de-4188-442f-b5ef-12253c2924c3 has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:52:03.345891 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:52:03.350868 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-953785e2-fef1-4d1c-9410-4012d0a60dfe admin admin] 10.222.0.66 "PUT /v2.0/routers/234433de-4188-442f-b5ef-12253c2924c3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4851191 Dec 08 11:52:03.354069 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33496) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:03.356819 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d013cd9e-9db4-4577-b050-86ab41a5634f None None] Sync routers for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:52:03.366490 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d013cd9e-9db4-4577-b050-86ab41a5634f None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:52:03.367200 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d013cd9e-9db4-4577-b050-86ab41a5634f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:51:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:03.456302 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Publish callbacks [] for router, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:03.470608 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-d013cd9e-9db4-4577-b050-86ab41a5634f None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: dv-cinder-819778-3-iscsi {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:52:03.556371 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:03.609634 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Deleting port c9282456-fdcc-4a90-83a3-fdaf335d07c3 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:52:03.610463 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:03.645557 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d013cd9e-9db4-4577-b050-86ab41a5634f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122'}], 'enable_snat': True}, 'gw_port_id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:52:02Z', 'revision_number': 5, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port': {'id': 'c9282456-fdcc-4a90-83a3-fdaf335d07c3', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:ee:45:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '234433de-4188-442f-b5ef-12253c2924c3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.122', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:43:58Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:03.675172 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d013cd9e-9db4-4577-b050-86ab41a5634f None None] Checking router: 234433de-4188-442f-b5ef-12253c2924c3 for host: dv-cinder-819778-3-iscsi {{(pid=102319) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:52:03.683388 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d013cd9e-9db4-4577-b050-86ab41a5634f None None] Routers {'234433de-4188-442f-b5ef-12253c2924c3'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102319) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:52:03.683988 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d013cd9e-9db4-4577-b050-86ab41a5634f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:51:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['234433de-4188-442f-b5ef-12253c2924c3'], 'active': True} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:03.687159 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] For port c9282456-fdcc-4a90-83a3-fdaf335d07c3, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=c9282456-fdcc-4a90-83a3-fdaf335d07c3,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:52:03.687521 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:03.700302 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Calling delete_port for c9282456-fdcc-4a90-83a3-fdaf335d07c3 owned by network:router_gateway {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:52:03.768687 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_dvr_db [None req-d013cd9e-9db4-4577-b050-86ab41a5634f None None] Set router 234433de-4188-442f-b5ef-12253c2924c3 gateway port host: None {{(pid=102319) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:52:03.820061 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.db.l3_hamode_db [None req-d013cd9e-9db4-4577-b050-86ab41a5634f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:52:03Z', 'revision_number': 6, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port_host': None}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102319) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:03.848668 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d013cd9e-9db4-4577-b050-86ab41a5634f None None] The sync data for ids ['234433de-4188-442f-b5ef-12253c2924c3'] in dv-cinder-819778-3-iscsi is: [{'id': '234433de-4188-442f-b5ef-12253c2924c3', 'name': 'tempest-TestVolumeBootPattern-1404242936-router', 'tenant_id': '8cd51b040b7242d084a290de749786b8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:53Z', 'updated_at': '2021-12-08T11:52:03Z', 'revision_number': 6, 'project_id': '8cd51b040b7242d084a290de749786b8', 'gw_port_host': None}] {{(pid=102319) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:52:03.861735 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:03.882038 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:52:03.896186 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Pushing event deleted for resources: {'Port': ['ID=c9282456-fdcc-4a90-83a3-fdaf335d07c3,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:03.954988 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7889737'] for router_gateway, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.039727 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7895253', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32185'] for router, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.041793 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.085498 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7895086'] for router, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.085983 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 234433de-4188-442f-b5ef-12253c2924c3 {{(pid=102318) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 08 11:52:04.091283 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] Publish callbacks [] for router, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.094717 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-05aace2e-08a6-4f4f-956a-be375f394f8c admin admin] 10.222.0.66 "DELETE /v2.0/routers/234433de-4188-442f-b5ef-12253c2924c3 HTTP/1.1" status: 204 len: 168 time: 0.7373753 Dec 08 11:52:04.094997 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33498) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:04.143506 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_v2 [None req-441f5d92-b94d-459a-aecd-27d227bf13bc admin admin] Deleting subnet 4923b9ae-1dff-4272-9f7a-1921aac84705 {{(pid=102318) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:52:04.146579 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-441f5d92-b94d-459a-aecd-27d227bf13bc admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.179321 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-441f5d92-b94d-459a-aecd-27d227bf13bc admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16370044'] for subnet, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.257168 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-441f5d92-b94d-459a-aecd-27d227bf13bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.312182 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-441f5d92-b94d-459a-aecd-27d227bf13bc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4572160', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-16496636'] for subnet, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.336760 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-441f5d92-b94d-459a-aecd-27d227bf13bc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4923b9ae-1dff-4272-9f7a-1921aac84705,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:04.340239 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-441f5d92-b94d-459a-aecd-27d227bf13bc admin admin] Publish callbacks [] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.343420 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-441f5d92-b94d-459a-aecd-27d227bf13bc admin admin] 10.222.0.66 "DELETE /v2.0/subnets/4923b9ae-1dff-4272-9f7a-1921aac84705 HTTP/1.1" status: 204 len: 168 time: 0.2474906 Dec 08 11:52:04.346459 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33500) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:04.348959 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bb876631-d2e8-4d0a-9369-6c4f40ec64ab None None] Network b6155a6c-7a89-4b5b-b3cb-d77c93560254 requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:52:04.411863 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.464240 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Deleting port 576d7257-e566-4e6a-8118-cd7311b9863e {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:52:04.464578 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.527775 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] For port 576d7257-e566-4e6a-8118-cd7311b9863e, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=576d7257-e566-4e6a-8118-cd7311b9863e,segment=NetworkSegment(ff555cf3-b8bf-4823-b4fd-8d10dfe59870),segment_id=ff555cf3-b8bf-4823-b4fd-8d10dfe59870)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:52:04.528131 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.540792 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Calling delete_port for 576d7257-e566-4e6a-8118-cd7311b9863e owned by network:dhcp {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:52:04.619559 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.626897 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eef1fed2-8e45-459e-9540-25c0c4b6c550 None None] DHCP port deletion for b6155a6c-7a89-4b5b-b3cb-d77c93560254 request from dv-cinder-819778-3-iscsi {{(pid=102319) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 08 11:52:04.655202 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] No DVR routers for this DVR port 576d7257-e566-4e6a-8118-cd7311b9863e on host dv-cinder-819778-3-iscsi {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:52:04.659135 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Pushing event deleted for resources: {'Port': ['ID=576d7257-e566-4e6a-8118-cd7311b9863e,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:04.728627 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.748467 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b6155a6c-7a89-4b5b-b3cb-d77c93560254']}} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:04.758355 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870') {'for_net_delete': True} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:04.758698 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ff555cf3-b8bf-4823-b4fd-8d10dfe59870') {} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:04.769085 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16370039'] for segment, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.782563 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.788394 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Releasing vlan 258 on physical network physnet1 to pool {{(pid=102318) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:52:04.788769 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4575654'] for segment, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: Traceback (most recent call last): Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: timer() Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: cb(*args, **kw) Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: return func(*args, **kwargs) Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: self._notify() Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: self.callback(batched_events) Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: event.method(event) Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: return f(self, *a, **k) Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._get(url).json() Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: return self.request(url, 'GET', **kwargs) Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:52:04.790428 dv-cinder-819778-3-iscsi neutron-server[102318]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:52:04.847673 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.853596 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:04.858714 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] 10.222.0.66 "DELETE /v2.0/networks/b6155a6c-7a89-4b5b-b3cb-d77c93560254 HTTP/1.1" status: 204 len: 168 time: 0.5093298 Dec 08 11:52:04.859716 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.wsgi [-] (102317) accepted ('10.222.0.66', 33502) {{(pid=102317) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:04.874321 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfcd196d-1c6f-470f-82b9-e2394284327a admin admin] Pushing event deleted for resources: {'Network': ['ID=b6155a6c-7a89-4b5b-b3cb-d77c93560254,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:04.926150 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device c9282456-fdcc-4a90-83a3-fdaf335d07c3 no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:52:04.946410 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: c9282456-fdcc-4a90-83a3-fdaf335d07c3 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:52:04.946753 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device c9282456-fdcc-4a90-83a3-fdaf335d07c3 not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:52:04.947168 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:52:04.965772 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:52:04.966113 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 7ab3f4bf-1191-4491-9b0f-e248b2de3a62 not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:52:04.966529 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 576d7257-e566-4e6a-8118-cd7311b9863e no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:52:04.985574 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 576d7257-e566-4e6a-8118-cd7311b9863e {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:52:04.985921 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 576d7257-e566-4e6a-8118-cd7311b9863e not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:52:05.199436 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8153c101-7998-43f6-ae5e-476275f810b7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-7897011'] for router_interface, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:05.433734 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-8153c101-7998-43f6-ae5e-476275f810b7 admin admin] Deleting port 77409d9a-96ec-474c-b9a0-aecddc71a945 {{(pid=102317) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:52:05.434065 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8153c101-7998-43f6-ae5e-476275f810b7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:05.509848 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.db [None req-8153c101-7998-43f6-ae5e-476275f810b7 admin admin] For port 77409d9a-96ec-474c-b9a0-aecddc71a945, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=77409d9a-96ec-474c-b9a0-aecddc71a945,segment=NetworkSegment(65cb28d1-d108-442c-9aee-e3538006a272),segment_id=65cb28d1-d108-442c-9aee-e3538006a272)] {{(pid=102317) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:52:05.510124 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8153c101-7998-43f6-ae5e-476275f810b7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:05.522927 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.plugins.ml2.plugin [None req-8153c101-7998-43f6-ae5e-476275f810b7 admin admin] Calling delete_port for 77409d9a-96ec-474c-b9a0-aecddc71a945 owned by network:router_interface {{(pid=102317) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:52:05.695468 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8153c101-7998-43f6-ae5e-476275f810b7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5648428'] for port, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:05.907992 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8153c101-7998-43f6-ae5e-476275f810b7 admin admin] Pushing event deleted for resources: {'Port': ['ID=77409d9a-96ec-474c-b9a0-aecddc71a945,revision_number=None']} {{(pid=102317) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:06.071871 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron_lib.callbacks.manager [None req-8153c101-7998-43f6-ae5e-476275f810b7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-8074906', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-7896871'] for router_interface, after_delete {{(pid=102317) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:06.291451 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8153c101-7998-43f6-ae5e-476275f810b7 admin admin] Router faaa5ca6-c2df-423e-aa75-314bee408a5b has already been hosted by L3 agent eec60700-e6c9-4d8b-90a7-eacce745fb7f {{(pid=102317) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 08 11:52:06.394808 dv-cinder-819778-3-iscsi neutron-server[102317]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8153c101-7998-43f6-ae5e-476275f810b7 admin admin] Notify agent at l3_agent.dv-cinder-819778-3-iscsi the message routers_updated {{(pid=102317) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 08 11:52:06.399874 dv-cinder-819778-3-iscsi neutron-server[102317]: INFO neutron.wsgi [None req-8153c101-7998-43f6-ae5e-476275f810b7 admin admin] 10.222.0.66 "PUT /v2.0/routers/faaa5ca6-c2df-423e-aa75-314bee408a5b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5391376 Dec 08 11:52:06.402528 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33504) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:06.403280 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb858eaa-2b81-4c0a-a1a0-f461b7126fba None None] Sync routers for ids ['faaa5ca6-c2df-423e-aa75-314bee408a5b'] in dv-cinder-819778-3-iscsi {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 08 11:52:06.419933 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb858eaa-2b81-4c0a-a1a0-f461b7126fba None None] Routers {'faaa5ca6-c2df-423e-aa75-314bee408a5b'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:52:06.420856 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-eb858eaa-2b81-4c0a-a1a0-f461b7126fba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:51:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['faaa5ca6-c2df-423e-aa75-314bee408a5b'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:06.506205 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Publish callbacks [] for router, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:06.527014 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-eb858eaa-2b81-4c0a-a1a0-f461b7126fba None None] Set router faaa5ca6-c2df-423e-aa75-314bee408a5b gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:52:06.702295 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-eb858eaa-2b81-4c0a-a1a0-f461b7126fba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'name': 'tempest-TestVolumeBootPattern-908931225-router', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112'}], 'enable_snat': True}, 'gw_port_id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:52:05Z', 'revision_number': 5, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'gw_port': {'id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:13:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:44:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:06.733307 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb858eaa-2b81-4c0a-a1a0-f461b7126fba None None] Checking router: faaa5ca6-c2df-423e-aa75-314bee408a5b for host: dv-cinder-819778-3-iscsi {{(pid=102320) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 08 11:52:06.741847 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb858eaa-2b81-4c0a-a1a0-f461b7126fba None None] Routers {'faaa5ca6-c2df-423e-aa75-314bee408a5b'} bound to L3 agent in host dv-cinder-819778-3-iscsi {{(pid=102320) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 08 11:52:06.742454 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-eb858eaa-2b81-4c0a-a1a0-f461b7126fba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819778-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-08T11:23:25Z,description=,heartbeat_timestamp=2021-12-08T11:51:55Z,host='dv-cinder-819778-3-iscsi',id=eec60700-e6c9-4d8b-90a7-eacce745fb7f,load=0,resource_versions=,resources_synced=,started_at=2021-12-08T11:23:25Z,topic='l3_agent')) {'router_ids': ['faaa5ca6-c2df-423e-aa75-314bee408a5b'], 'active': True} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:06.845559 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_dvr_db [None req-eb858eaa-2b81-4c0a-a1a0-f461b7126fba None None] Set router faaa5ca6-c2df-423e-aa75-314bee408a5b gateway port host: dv-cinder-819778-3-iscsi {{(pid=102320) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 08 11:52:06.880919 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:06.939329 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Deleting port 21b6c408-2013-43fa-9eda-e37a66c387b9 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:52:06.939665 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.015542 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] For port 21b6c408-2013-43fa-9eda-e37a66c387b9, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=21b6c408-2013-43fa-9eda-e37a66c387b9,segment=NetworkSegment(aced9233-ae52-4905-86c8-d88de08554cc),segment_id=aced9233-ae52-4905-86c8-d88de08554cc)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:52:07.015829 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.020475 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.l3_hamode_db [None req-eb858eaa-2b81-4c0a-a1a0-f461b7126fba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'name': 'tempest-TestVolumeBootPattern-908931225-router', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112'}], 'enable_snat': True}, 'gw_port_id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:52:05Z', 'revision_number': 5, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'gw_port': {'id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:13:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:44:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}], 'dv-cinder-819778-3-iscsi', False) {} {{(pid=102320) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:07.029199 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Calling delete_port for 21b6c408-2013-43fa-9eda-e37a66c387b9 owned by network:router_gateway {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:52:07.047465 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb858eaa-2b81-4c0a-a1a0-f461b7126fba None None] The sync data for ids ['faaa5ca6-c2df-423e-aa75-314bee408a5b'] in dv-cinder-819778-3-iscsi is: [{'id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'name': 'tempest-TestVolumeBootPattern-908931225-router', 'tenant_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'external_fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112'}], 'enable_snat': True}, 'gw_port_id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:52:05Z', 'revision_number': 5, 'project_id': '4c5c7c9211184c1a9e4434afb8d87c87', 'gw_port': {'id': '21b6c408-2013-43fa-9eda-e37a66c387b9', 'name': '', 'network_id': 'd7cb3021-649a-44ca-b3a1-005b3941164e', 'tenant_id': '', 'mac_address': 'fa:16:3e:93:13:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'faaa5ca6-c2df-423e-aa75-314bee408a5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 683, 'fixed_ips': [{'subnet_id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'ip_address': '172.27.2.112', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819778-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-08T11:43:58Z', 'updated_at': '2021-12-08T11:44:04Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'd3c85f21-b354-4935-be9d-64f27cdb4486', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819778-3-iscsi'}] {{(pid=102320) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 08 11:52:07.189863 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.217317 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Pushing event deleted for resources: {'Port': ['ID=21b6c408-2013-43fa-9eda-e37a66c387b9,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:07.276019 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-7889737'] for router_gateway, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.361632 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-7895253', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-32185'] for router, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.364684 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.409141 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-7895086'] for router, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.409688 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Fanout notify agent at l3_agent the message router_deleted on router faaa5ca6-c2df-423e-aa75-314bee408a5b {{(pid=102318) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 08 11:52:07.414380 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] Publish callbacks [] for router, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.415609 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-4b32c42e-0309-4575-a0e9-5ef952ad998a admin admin] 10.222.0.66 "DELETE /v2.0/routers/faaa5ca6-c2df-423e-aa75-314bee408a5b HTTP/1.1" status: 204 len: 168 time: 1.0120451 Dec 08 11:52:07.418021 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33506) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:07.466912 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.db_base_plugin_v2 [None req-1b04d916-f635-4760-ac34-41bb975118b1 admin admin] Deleting subnet 7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8 {{(pid=102318) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 08 11:52:07.470407 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1b04d916-f635-4760-ac34-41bb975118b1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.505700 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1b04d916-f635-4760-ac34-41bb975118b1 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-16370044'] for subnet, precommit_delete_associations {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.580461 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1b04d916-f635-4760-ac34-41bb975118b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-679728'] for subnet, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.638353 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1b04d916-f635-4760-ac34-41bb975118b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-679723', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7919731', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-4572160', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-16496636'] for subnet, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.662143 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b04d916-f635-4760-ac34-41bb975118b1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:07.667737 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-1b04d916-f635-4760-ac34-41bb975118b1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.671081 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-1b04d916-f635-4760-ac34-41bb975118b1 admin admin] 10.222.0.66 "DELETE /v2.0/subnets/7f9ef071-f2e7-4906-a3e0-6ceaf56d5da8 HTTP/1.1" status: 204 len: 168 time: 0.2520454 Dec 08 11:52:07.673713 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33508) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:07.683990 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5b4c802-91a4-491b-a7bf-dfcbaaf97191 None None] Network 4b07857a-ba9d-41f1-8e5c-bf328cc970ca requested from dv-cinder-819778-3-iscsi {{(pid=102319) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 08 11:52:07.739707 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-829180'] for network, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.793505 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Deleting port 19c8d491-18d8-47e4-9db1-da9927e88510 {{(pid=102318) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 08 11:52:07.793847 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8729986958942'] for port, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.856319 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.db [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] For port 19c8d491-18d8-47e4-9db1-da9927e88510, host dv-cinder-819778-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819778-3-iscsi',level=0,port_id=19c8d491-18d8-47e4-9db1-da9927e88510,segment=NetworkSegment(65cb28d1-d108-442c-9aee-e3538006a272),segment_id=65cb28d1-d108-442c-9aee-e3538006a272)] {{(pid=102318) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 08 11:52:07.856673 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-7891105'] for port, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.868864 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.plugin [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Calling delete_port for 19c8d491-18d8-47e4-9db1-da9927e88510 owned by network:dhcp {{(pid=102318) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 08 11:52:07.944808 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-656683', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-107532', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8729986960824', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8729986444737', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-4575731'] for port, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:07.974570 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] No DVR routers for this DVR port 19c8d491-18d8-47e4-9db1-da9927e88510 on host dv-cinder-819778-3-iscsi {{(pid=102318) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 08 11:52:07.976113 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Pushing event deleted for resources: {'Port': ['ID=19c8d491-18d8-47e4-9db1-da9927e88510,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:08.001533 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-716dcee9-f983-4a52-8527-e33b560f8f6a None None] DHCP port deletion for 4b07857a-ba9d-41f1-8e5c-bf328cc970ca request from dv-cinder-819778-3-iscsi {{(pid=102319) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 08 11:52:08.051708 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-582847', 'neutron.services.segments.db._delete_segments_for_network-8729987010416'] for network, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.071327 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4b07857a-ba9d-41f1-8e5c-bf328cc970ca']}} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:08.080599 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '65cb28d1-d108-442c-9aee-e3538006a272') {'for_net_delete': True} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:08.081065 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.services.segments.db [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '65cb28d1-d108-442c-9aee-e3538006a272') {} {{(pid=102318) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 08 11:52:08.092203 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8729986918009', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-16370039'] for segment, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.106107 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521'] for segment, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.112493 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Releasing vlan 288 on physical network physnet1 to pool {{(pid=102318) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 08 11:52:08.112822 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-676521', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-4575654'] for segment, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: Traceback (most recent call last): Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: timer() Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: cb(*args, **kw) Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: return func(*args, **kwargs) Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: self._notify() Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: self.callback(batched_events) Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: event.method(event) Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: aggregate_uuid = self.p_client.list_aggregates( Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: return f(self, *a, **k) Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._get(url).json() Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: return self.request(url, 'GET', **kwargs) Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: base_url = self.get_endpoint(auth, allow=allow, Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 08 11:52:08.114464 dv-cinder-819778-3-iscsi neutron-server[102318]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 08 11:52:08.169758 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-582838', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922635', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-8074881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-7898785'] for network, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.176437 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-8074943'] for network, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.179671 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] 10.222.0.66 "DELETE /v2.0/networks/4b07857a-ba9d-41f1-8e5c-bf328cc970ca HTTP/1.1" status: 204 len: 168 time: 0.5050349 Dec 08 11:52:08.189623 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bc00a36-0740-47c4-a39c-3fffedc7c38e admin admin] Pushing event deleted for resources: {'Network': ['ID=4b07857a-ba9d-41f1-8e5c-bf328cc970ca,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:08.291772 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33512) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:08.331298 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-1ff8f5c6-0b0a-498f-95c4-79f5b7b320f0 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=8cd51b040b7242d084a290de749786b8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0383642 Dec 08 11:52:08.333778 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33514) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:08.379457 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-775c8090-2139-4905-ae2f-ed3b87d24584 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.399603 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-775c8090-2139-4905-ae2f-ed3b87d24584 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.443510 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-775c8090-2139-4905-ae2f-ed3b87d24584 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.446380 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-775c8090-2139-4905-ae2f-ed3b87d24584 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.447525 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-775c8090-2139-4905-ae2f-ed3b87d24584 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/ca139cba-47aa-43e1-9c5f-05a1fe2f205c HTTP/1.1" status: 204 len: 168 time: 0.1128654 Dec 08 11:52:08.455880 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-775c8090-2139-4905-ae2f-ed3b87d24584 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca139cba-47aa-43e1-9c5f-05a1fe2f205c,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:08.759231 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33520) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:08.800981 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-94bdb7d8-d556-4f36-9ab4-fbef096e9583 admin admin] 10.222.0.66 "GET /v2.0/security-groups?tenant_id=4c5c7c9211184c1a9e4434afb8d87c87&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0406330 Dec 08 11:52:08.803392 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [-] (102318) accepted ('10.222.0.66', 33522) {{(pid=102318) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 08 11:52:08.848904 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24825798-391d-44cb-8bdf-4571bb919bb3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.869548 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24825798-391d-44cb-8bdf-4571bb919bb3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.917609 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24825798-391d-44cb-8bdf-4571bb919bb3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-7922456'] for security_group, after_delete {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.921695 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron_lib.callbacks.manager [None req-24825798-391d-44cb-8bdf-4571bb919bb3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102318) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:08.922924 dv-cinder-819778-3-iscsi neutron-server[102318]: INFO neutron.wsgi [None req-24825798-391d-44cb-8bdf-4571bb919bb3 admin admin] 10.222.0.66 "DELETE /v2.0/security-groups/1328b6f2-0ee8-47b9-95dc-2a44753f2f34 HTTP/1.1" status: 204 len: 168 time: 0.1186132 Dec 08 11:52:08.928102 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 21b6c408-2013-43fa-9eda-e37a66c387b9 no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:52:08.934145 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24825798-391d-44cb-8bdf-4571bb919bb3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1328b6f2-0ee8-47b9-95dc-2a44753f2f34,revision_number=None']} {{(pid=102318) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 08 11:52:08.950427 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 21b6c408-2013-43fa-9eda-e37a66c387b9 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:52:08.950773 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 21b6c408-2013-43fa-9eda-e37a66c387b9 not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:52:08.951190 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 19c8d491-18d8-47e4-9db1-da9927e88510 no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:52:08.977256 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 19c8d491-18d8-47e4-9db1-da9927e88510 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:52:08.977603 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 19c8d491-18d8-47e4-9db1-da9927e88510 not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:52:08.978019 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 77409d9a-96ec-474c-b9a0-aecddc71a945 no longer exists at agent ovs-agent-dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 08 11:52:08.997578 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.plugin [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] No Port match for: 77409d9a-96ec-474c-b9a0-aecddc71a945 {{(pid=102319) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 08 11:52:08.997922 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron.plugins.ml2.rpc [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Device 77409d9a-96ec-474c-b9a0-aecddc71a945 not bound to the agent host dv-cinder-819778-3-iscsi {{(pid=102319) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 08 11:52:17.786488 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:22.510320 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-923d86d2-43ed-4046-bbf8-d0e436ddd1d8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:24.746432 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9e6957e5-31c7-49f2-94e1-7560d16e716e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:25.865607 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:27.217890 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:28.209560 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:40.881792 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:52:47.800340 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:52.512456 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-4a60a97f-f26c-4dc6-8be7-f6e62d856ddf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:54.746662 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-bd786502-94cd-467f-a6e6-fa776d5c4a7a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:55.867913 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:57.221116 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:52:58.211919 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:53:17.814494 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:53:17.880974 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:53:22.513841 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-af52faaa-3a5a-42f0-b37d-0292ad70d297 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:53:24.747756 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-c1151619-daa0-4aac-a358-02d7db139701 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:53:25.870803 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:53:27.223746 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:53:28.213661 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:53:47.813375 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:53:52.515443 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-87bdb166-e6ad-460e-aa61-08bc854eca0a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:53:54.749087 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-040e2a99-f482-45b9-8bab-f8f7cd4275d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:53:54.879625 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:53:55.872688 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:53:57.225633 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:53:58.216749 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:54:17.849444 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:54:22.518673 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-0defad56-40e6-43aa-a601-2be54095d297 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:54:24.750369 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9d2bf464-05a2-4253-a163-3bfea5d9f451 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:54:25.875129 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:54:27.230731 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:54:28.218202 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:54:31.878567 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:54:47.856909 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:54:52.520556 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-58a7391b-5eb4-44e3-a857-e7546692b36d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:54:54.752458 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-3a2902e5-6a4b-4d7a-9736-9bb25a155c0f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:54:55.877313 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:54:57.232968 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:54:58.219967 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:55:08.878854 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:55:17.863260 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:55:22.520994 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-58cb1624-53c2-4b59-986e-b2d8173b199d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:55:24.754809 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-1f947623-9196-4f01-a9f9-e67cd1cf833b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:55:25.879717 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:55:27.235848 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:55:28.221476 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:55:45.877276 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:55:47.870127 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:55:52.521495 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-d4cbddd7-085a-4497-a80f-d9ea2c11d0f7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:55:54.756688 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-2087459b-f33d-4cae-9f8e-3663723862cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:55:55.882740 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:55:57.237877 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:55:58.223254 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:56:00.391537 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [req-1dc29ac6-3648-4697-93bb-5637f14cb44d req-5df14a79-6d54-4b75-a2b3-a7b907661550 service neutron] (102318) timed out ('10.222.0.66', 54808) {{(pid=102318) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 08 11:56:17.016912 dv-cinder-819778-3-iscsi neutron-server[102318]: DEBUG neutron.wsgi [req-d8fc42d9-4edc-4977-abce-8f5520050f5d req-0ca8e7ff-7669-4387-a688-e079a7b369ff service neutron] (102318) timed out ('10.222.0.61', 56911) {{(pid=102318) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 08 11:56:17.869035 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:56:22.522635 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-272d43e8-7b8b-48e1-8ca6-fde6c8d97237 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:56:22.875299 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:56:24.757136 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-065e8a58-f57a-45fc-84d1-4ae1f491046d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:56:25.888518 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:56:27.240147 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:56:28.225402 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:56:47.883606 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:56:52.523626 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-95b6a08a-311c-47ff-827b-12ca915ea144 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:56:54.759171 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-4d2c7564-2622-44fe-a771-225812637e45 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:56:55.889674 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:56:57.243473 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:56:58.226653 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:56:59.874311 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 08 11:57:17.890008 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-fc78b1f2-415a-4264-beac-e21948e7b922 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:57:22.525489 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a9aa36a6-4c3e-4c2a-8e0f-ca5cc1e0070c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:57:24.761221 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-b1a1086e-dc9d-46b4-af6b-232e8ed2ee98 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:57:25.890768 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-a1bfa354-01e1-44d3-bba5-e77e8a26f5d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:57:27.246426 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-9fc400f1-5b4d-45d3-8d1d-e672c50e3c8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:57:28.229598 dv-cinder-819778-3-iscsi neutron-server[102319]: DEBUG neutron_lib.callbacks.manager [None req-30361ce1-2507-41bb-ae30-1b2aeeaecf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8729987010398', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-585073'] for agent, after_update {{(pid=102319) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 08 11:57:36.873844 dv-cinder-819778-3-iscsi neutron-server[102320]: DEBUG neutron.db.agents_db [None req-eab19d41-1474-44aa-8026-1fab21122e93 None None] Agent healthcheck: found 6 active agents {{(pid=102320) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}